2026-02-13T21:09:08.071 INFO:root:teuthology version: 1.2.4.dev6+g76f36e686 2026-02-13T21:09:08.088 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T21:09:08.167 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085 branch: wip-jcollin-testing-20260213.155635-tentacle description: fs/cephadm/renamevolume/{0-start 1-rename conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '50085' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-jcollin-testing-20260213.155635-tentacle ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - pg .* is stuck peering sha1: 3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-jcollin-testing-20260213.155635-tentacle sha1: 3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - host.b - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 3637 sha1: 3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 sleep_before_teardown: 0 subset: 932/1024 suite: fs suite_branch: wip-jcollin-testing-20260213.155635-tentacle suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 targets: trial012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxSdL6BR90Gcsi0oxa8i+CxhVH8DcpZc1AWrqELO9SB8/l7o88XPVmHljVzNxbbSpTxRgUNLcsaln6awTdNKsQ= trial090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMMQZJCtRcBMRPKwuo2Hop5t1A+Xua5mURbbZ/gOVL7vdxUrn6pxWYsC8xH1Arv9npwJ7kjW1S64sNbVYgyHwA= tasks: - install: null - cephadm: roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create foo - fs.ready: timeout: 300 - cephadm.shell: host.a: - ceph fs fail foo - ceph fs set foo refuse_client_session true - ceph fs volume rename foo bar --yes-i-really-mean-it - ceph fs set bar joinable true - ceph fs set bar refuse_client_session false - fs.ready: timeout: 300 - cephadm.shell: host.a: - 'set -ex ceph orch ls mds --format=json | jq ".[] | .service_name" | grep "mds.bar" ' - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: kernel-fix teuthology_sha1: 76f36e6865be4ddcb29d455f126a084282247ea4 timestamp: 2026-02-13_20:31:39 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T21:09:08.167 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/qa; will attempt to use it 2026-02-13T21:09:08.168 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/qa/tasks 2026-02-13T21:09:08.168 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T21:09:08.169 INFO:teuthology.task.internal:Checking packages... 2026-02-13T21:09:08.169 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33' 2026-02-13T21:09:08.169 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T21:09:08.169 INFO:teuthology.packaging:ref: None 2026-02-13T21:09:08.170 INFO:teuthology.packaging:tag: None 2026-02-13T21:09:08.170 INFO:teuthology.packaging:branch: wip-jcollin-testing-20260213.155635-tentacle 2026-02-13T21:09:08.170 INFO:teuthology.packaging:sha1: 3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:09:08.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-jcollin-testing-20260213.155635-tentacle 2026-02-13T21:09:08.290 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-690.g3baf6bae 2026-02-13T21:09:08.291 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T21:09:08.303 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T21:09:08.303 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T21:09:08.317 INFO:teuthology.task.internal:Saving configuration 2026-02-13T21:09:08.329 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T21:09:08.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T21:09:08.418 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial012.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 21:05:44.615802', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxSdL6BR90Gcsi0oxa8i+CxhVH8DcpZc1AWrqELO9SB8/l7o88XPVmHljVzNxbbSpTxRgUNLcsaln6awTdNKsQ='} 2026-02-13T21:09:08.474 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial090.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 21:05:44.615115', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMMQZJCtRcBMRPKwuo2Hop5t1A+Xua5mURbbZ/gOVL7vdxUrn6pxWYsC8xH1Arv9npwJ7kjW1S64sNbVYgyHwA='} 2026-02-13T21:09:08.474 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T21:09:08.486 INFO:teuthology.task.internal:roles: ubuntu@trial012.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-13T21:09:08.486 INFO:teuthology.task.internal:roles: ubuntu@trial090.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2026-02-13T21:09:08.486 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T21:09:08.620 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x70126272b060>, signals=[15]) 2026-02-13T21:09:08.620 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T21:09:08.632 INFO:teuthology.task.internal:Opening connections... 2026-02-13T21:09:08.632 DEBUG:teuthology.task.internal:connecting to ubuntu@trial012.front.sepia.ceph.com 2026-02-13T21:09:08.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T21:09:08.695 DEBUG:teuthology.task.internal:connecting to ubuntu@trial090.front.sepia.ceph.com 2026-02-13T21:09:08.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T21:09:08.757 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T21:09:08.769 DEBUG:teuthology.orchestra.run.trial012:> uname -m 2026-02-13T21:09:08.784 INFO:teuthology.orchestra.run.trial012.stdout:x86_64 2026-02-13T21:09:08.784 DEBUG:teuthology.orchestra.run.trial012:> cat /etc/os-release 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:NAME="CentOS Stream" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:VERSION="9" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:ID="centos" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:ID_LIKE="rhel fedora" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:VERSION_ID="9" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:PLATFORM_ID="platform:el9" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:ANSI_COLOR="0;31" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:LOGO="fedora-logo-icon" 2026-02-13T21:09:08.840 INFO:teuthology.orchestra.run.trial012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T21:09:08.841 INFO:teuthology.orchestra.run.trial012.stdout:HOME_URL="https://centos.org/" 2026-02-13T21:09:08.841 INFO:teuthology.orchestra.run.trial012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T21:09:08.841 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T21:09:08.841 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T21:09:08.841 INFO:teuthology.lock.ops:Updating trial012.front.sepia.ceph.com on lock server 2026-02-13T21:09:08.914 DEBUG:teuthology.orchestra.run.trial090:> uname -m 2026-02-13T21:09:08.929 INFO:teuthology.orchestra.run.trial090.stdout:x86_64 2026-02-13T21:09:08.930 DEBUG:teuthology.orchestra.run.trial090:> cat /etc/os-release 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:NAME="CentOS Stream" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:VERSION="9" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:ID="centos" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:ID_LIKE="rhel fedora" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:VERSION_ID="9" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:PLATFORM_ID="platform:el9" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:ANSI_COLOR="0;31" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:LOGO="fedora-logo-icon" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:HOME_URL="https://centos.org/" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T21:09:08.986 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T21:09:08.987 INFO:teuthology.lock.ops:Updating trial090.front.sepia.ceph.com on lock server 2026-02-13T21:09:09.063 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T21:09:09.076 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T21:09:09.087 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T21:09:09.088 DEBUG:teuthology.orchestra.run.trial012:> test '!' -e /home/ubuntu/cephtest 2026-02-13T21:09:09.089 DEBUG:teuthology.orchestra.run.trial090:> test '!' -e /home/ubuntu/cephtest 2026-02-13T21:09:09.104 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T21:09:09.116 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T21:09:09.116 DEBUG:teuthology.orchestra.run.trial012:> test -z $(ls -A /var/lib/ceph) 2026-02-13T21:09:09.145 DEBUG:teuthology.orchestra.run.trial090:> test -z $(ls -A /var/lib/ceph) 2026-02-13T21:09:09.162 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T21:09:09.325 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T21:09:09.345 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-13T21:09:09.345 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-13T21:09:09.346 DEBUG:teuthology.orchestra.run.trial012:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T21:09:09.346 DEBUG:teuthology.orchestra.run.trial090:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T21:09:09.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T21:09:09.361 DEBUG:teuthology.orchestra.run.trial012:> uname -r 2026-02-13T21:09:09.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T21:09:09.361 DEBUG:teuthology.orchestra.run.trial090:> uname -r 2026-02-13T21:09:09.416 INFO:teuthology.orchestra.run.trial012.stdout:5.14.0-645.el9.x86_64 2026-02-13T21:09:09.416 INFO:teuthology.task.kernel:Running kernel on trial012: 5.14.0-645.el9.x86_64 2026-02-13T21:09:09.416 DEBUG:teuthology.orchestra.run.trial012:> sudo yum install -y kernel 2026-02-13T21:09:09.416 INFO:teuthology.orchestra.run.trial090.stdout:5.14.0-645.el9.x86_64 2026-02-13T21:09:09.416 INFO:teuthology.task.kernel:Running kernel on trial090: 5.14.0-645.el9.x86_64 2026-02-13T21:09:09.416 DEBUG:teuthology.orchestra.run.trial090:> sudo yum install -y kernel 2026-02-13T21:09:10.487 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-13T21:09:13.626 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-13T21:09:16.043 INFO:teuthology.orchestra.run.trial012.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.9 MB 00:06 2026-02-13T21:09:17.744 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 7.8 MB 00:01 2026-02-13T21:09:19.099 INFO:teuthology.orchestra.run.trial012.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T21:09:19.625 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-13T21:09:20.224 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-13T21:09:22.482 INFO:teuthology.orchestra.run.trial012.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-13T21:09:23.378 INFO:teuthology.orchestra.run.trial012.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 20 kB 00:00 2026-02-13T21:09:23.514 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 1.0 MB/s | 50 kB 00:00 2026-02-13T21:09:23.860 INFO:teuthology.orchestra.run.trial012.stdout:Extra Packages for Enterprise Linux 50 MB/s | 20 MB 00:00 2026-02-13T21:09:24.576 INFO:teuthology.orchestra.run.trial090.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T21:09:24.596 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:09:24.597 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:09:24.598 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:09:24.599 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:09:24.599 INFO:teuthology.orchestra.run.trial090.stdout:Install 4 Packages 2026-02-13T21:09:24.599 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:09:24.599 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 88 M 2026-02-13T21:09:24.599 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 135 M 2026-02-13T21:09:24.599 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:09:24.697 INFO:teuthology.orchestra.run.trial090.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 20 MB/s | 768 kB 00:00 2026-02-13T21:09:24.775 INFO:teuthology.orchestra.run.trial090.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 149 MB/s | 17 MB 00:00 2026-02-13T21:09:24.877 INFO:teuthology.orchestra.run.trial090.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 183 MB/s | 40 MB 00:00 2026-02-13T21:09:24.928 INFO:teuthology.orchestra.run.trial090.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 134 MB/s | 31 MB 00:00 2026-02-13T21:09:24.928 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:09:24.928 INFO:teuthology.orchestra.run.trial090.stdout:Total 267 MB/s | 88 MB 00:00 2026-02-13T21:09:25.118 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:09:25.332 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:09:25.332 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:09:25.678 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:09:25.678 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:09:26.771 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:09:27.050 INFO:teuthology.orchestra.run.trial012.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-13T21:09:27.054 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T21:09:27.073 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T21:09:28.110 INFO:teuthology.orchestra.run.trial012.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T21:09:28.130 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout: Package Architecture Version Repository Size 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout:Installing dependencies: 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:09:28.132 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:09:28.133 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:09:28.133 INFO:teuthology.orchestra.run.trial012.stdout:Install 4 Packages 2026-02-13T21:09:28.133 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:09:28.133 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 88 M 2026-02-13T21:09:28.133 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 135 M 2026-02-13T21:09:28.133 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:09:28.268 INFO:teuthology.orchestra.run.trial012.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 9.8 MB/s | 768 kB 00:00 2026-02-13T21:09:28.356 INFO:teuthology.orchestra.run.trial012.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 104 MB/s | 17 MB 00:00 2026-02-13T21:09:28.444 INFO:teuthology.orchestra.run.trial012.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 176 MB/s | 31 MB 00:00 2026-02-13T21:09:28.513 INFO:teuthology.orchestra.run.trial012.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 123 MB/s | 40 MB 00:00 2026-02-13T21:09:28.513 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:09:28.513 INFO:teuthology.orchestra.run.trial012.stdout:Total 231 MB/s | 88 MB 00:00 2026-02-13T21:09:28.700 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:09:28.835 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T21:09:28.863 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T21:09:28.900 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:09:28.900 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:09:29.246 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:09:29.246 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:09:30.336 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:09:30.620 INFO:teuthology.orchestra.run.trial012.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T21:09:30.639 INFO:teuthology.orchestra.run.trial012.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T21:09:31.894 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T21:09:31.901 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:09:32.400 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T21:09:32.428 INFO:teuthology.orchestra.run.trial012.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T21:09:35.001 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:09:35.457 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T21:09:35.463 INFO:teuthology.orchestra.run.trial012.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:09:38.500 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:05.618 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:05.641 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:05.704 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:05.704 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T21:10:05.704 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T21:10:05.704 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T21:10:05.757 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:05.757 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:10:05.757 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:10:05.757 INFO:teuthology.orchestra.run.trial090.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T21:10:05.757 INFO:teuthology.orchestra.run.trial090.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T21:10:05.757 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T21:10:05.757 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T21:10:05.757 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:10:05.758 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:10:05.814 DEBUG:teuthology.orchestra.run.trial090:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T21:10:05.839 INFO:teuthology.orchestra.run.trial090.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T21:10:05.840 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T21:10:05.841 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T21:10:05.841 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T21:10:05.841 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T21:10:05.841 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-13T21:10:05.841 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial090.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T21:10:05.841 DEBUG:teuthology.orchestra.run.trial090:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T21:10:05.903 INFO:teuthology.orchestra.run.trial090.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T21:10:05.904 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T21:10:05.905 DEBUG:teuthology.orchestra.run.trial090:> sudo rpm -qi grub2-tools 2026-02-13T21:10:05.973 INFO:teuthology.orchestra.run.trial090.stdout:Name : grub2-tools 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:Epoch : 1 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:Version : 2.06 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:Release : 118.el9 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:Architecture: x86_64 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:Group : Unspecified 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:Size : 8393909 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:License : GPLv3+ 2026-02-13T21:10:05.974 INFO:teuthology.orchestra.run.trial090.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:Packager : builder@centos.org 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:Vendor : CentOS 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:Summary : Support tools for GRUB. 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:Description : 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T21:10:05.975 INFO:teuthology.orchestra.run.trial090.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T21:10:05.976 INFO:teuthology.orchestra.run.trial090.stdout:hardware devices. 2026-02-13T21:10:05.976 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:10:05.976 INFO:teuthology.orchestra.run.trial090.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T21:10:05.977 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T21:10:05.977 INFO:teuthology.task.kernel:Updating grub on trial090 to boot 5.14.0-677.el9.x86_64 2026-02-13T21:10:05.977 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T21:10:06.039 INFO:teuthology.orchestra.run.trial090.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T21:10:06.040 DEBUG:teuthology.orchestra.run.trial090:> sudo command -v grubby && echo yes || echo no 2026-02-13T21:10:06.104 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/grubby 2026-02-13T21:10:06.105 INFO:teuthology.orchestra.run.trial090.stdout:yes 2026-02-13T21:10:06.105 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T21:10:06.171 INFO:teuthology.orchestra.run.trial090.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T21:10:06.172 DEBUG:teuthology.orchestra.run.trial090:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T21:10:06.245 DEBUG:teuthology.orchestra.run.trial090:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T21:10:06.459 INFO:teuthology.orchestra.run.trial090.stderr:Generating grub configuration file ... 2026-02-13T21:10:06.522 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T21:10:06.529 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T21:10:06.790 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T21:10:06.796 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T21:10:06.829 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T21:10:06.835 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T21:10:06.857 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T21:10:06.864 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T21:10:06.948 INFO:teuthology.orchestra.run.trial090.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T21:10:06.956 INFO:teuthology.orchestra.run.trial090.stderr:done 2026-02-13T21:10:06.958 DEBUG:teuthology.orchestra.run.trial090:> test -d /sys/firmware/efi 2026-02-13T21:10:06.974 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T21:10:07.038 INFO:teuthology.orchestra.run.trial090.stdout:/boot/efi/EFI/BOOT 2026-02-13T21:10:07.038 INFO:teuthology.orchestra.run.trial090.stdout:/boot/efi/EFI/centos 2026-02-13T21:10:07.040 DEBUG:teuthology.orchestra.run.trial090:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T21:10:07.106 INFO:teuthology.orchestra.run.trial090.stdout:no 2026-02-13T21:10:07.107 DEBUG:teuthology.orchestra.run.trial090:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T21:10:07.171 INFO:teuthology.orchestra.run.trial090.stdout:yes 2026-02-13T21:10:07.172 DEBUG:teuthology.orchestra.run.trial090:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T21:10:07.238 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial090 2026-02-13T21:10:07.238 DEBUG:teuthology.orchestra.run.trial090:> sudo bash -c ' 2026-02-13T21:10:07.239 DEBUG:teuthology.orchestra.run.trial090:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-13T21:10:07.239 DEBUG:teuthology.orchestra.run.trial090:> ' 2026-02-13T21:10:08.864 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:08.884 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:09.054 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:09.054 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T21:10:09.054 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T21:10:09.054 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T21:10:09.105 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T21:10:09.106 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:10:09.106 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:10:09.106 INFO:teuthology.orchestra.run.trial012.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T21:10:09.106 INFO:teuthology.orchestra.run.trial012.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T21:10:09.106 INFO:teuthology.orchestra.run.trial012.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T21:10:09.106 INFO:teuthology.orchestra.run.trial012.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T21:10:09.106 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:10:09.106 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:10:09.164 DEBUG:teuthology.orchestra.run.trial012:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T21:10:09.190 INFO:teuthology.orchestra.run.trial012.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T21:10:09.191 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T21:10:09.192 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T21:10:09.192 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T21:10:09.192 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T21:10:09.192 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-13T21:10:09.192 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial012.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T21:10:09.192 DEBUG:teuthology.orchestra.run.trial012:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T21:10:09.256 INFO:teuthology.orchestra.run.trial012.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T21:10:09.256 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T21:10:09.257 DEBUG:teuthology.orchestra.run.trial012:> sudo rpm -qi grub2-tools 2026-02-13T21:10:09.325 INFO:teuthology.orchestra.run.trial012.stdout:Name : grub2-tools 2026-02-13T21:10:09.325 INFO:teuthology.orchestra.run.trial012.stdout:Epoch : 1 2026-02-13T21:10:09.325 INFO:teuthology.orchestra.run.trial012.stdout:Version : 2.06 2026-02-13T21:10:09.325 INFO:teuthology.orchestra.run.trial012.stdout:Release : 118.el9 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Architecture: x86_64 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Group : Unspecified 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Size : 8393909 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:License : GPLv3+ 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Packager : builder@centos.org 2026-02-13T21:10:09.326 INFO:teuthology.orchestra.run.trial012.stdout:Vendor : CentOS 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout:Summary : Support tools for GRUB. 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout:Description : 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout:hardware devices. 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:10:09.327 INFO:teuthology.orchestra.run.trial012.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T21:10:09.329 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T21:10:09.329 INFO:teuthology.task.kernel:Updating grub on trial012 to boot 5.14.0-677.el9.x86_64 2026-02-13T21:10:09.329 DEBUG:teuthology.orchestra.run.trial012:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T21:10:09.393 INFO:teuthology.orchestra.run.trial012.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T21:10:09.395 DEBUG:teuthology.orchestra.run.trial012:> sudo command -v grubby && echo yes || echo no 2026-02-13T21:10:09.460 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/grubby 2026-02-13T21:10:09.461 INFO:teuthology.orchestra.run.trial012.stdout:yes 2026-02-13T21:10:09.462 DEBUG:teuthology.orchestra.run.trial012:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T21:10:09.526 INFO:teuthology.orchestra.run.trial012.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T21:10:09.527 DEBUG:teuthology.orchestra.run.trial012:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T21:10:09.599 DEBUG:teuthology.orchestra.run.trial012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T21:10:09.806 INFO:teuthology.orchestra.run.trial012.stderr:Generating grub configuration file ... 2026-02-13T21:10:09.870 INFO:teuthology.orchestra.run.trial012.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T21:10:09.877 INFO:teuthology.orchestra.run.trial012.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T21:10:10.128 INFO:teuthology.orchestra.run.trial012.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T21:10:10.134 INFO:teuthology.orchestra.run.trial012.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T21:10:10.167 INFO:teuthology.orchestra.run.trial012.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T21:10:10.173 INFO:teuthology.orchestra.run.trial012.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T21:10:10.196 INFO:teuthology.orchestra.run.trial012.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T21:10:10.203 INFO:teuthology.orchestra.run.trial012.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T21:10:10.285 INFO:teuthology.orchestra.run.trial012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T21:10:10.293 INFO:teuthology.orchestra.run.trial012.stderr:done 2026-02-13T21:10:10.295 DEBUG:teuthology.orchestra.run.trial012:> test -d /sys/firmware/efi 2026-02-13T21:10:10.312 DEBUG:teuthology.orchestra.run.trial012:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T21:10:10.378 INFO:teuthology.orchestra.run.trial012.stdout:/boot/efi/EFI/BOOT 2026-02-13T21:10:10.379 INFO:teuthology.orchestra.run.trial012.stdout:/boot/efi/EFI/centos 2026-02-13T21:10:10.380 DEBUG:teuthology.orchestra.run.trial012:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T21:10:10.446 INFO:teuthology.orchestra.run.trial012.stdout:no 2026-02-13T21:10:10.446 DEBUG:teuthology.orchestra.run.trial012:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T21:10:10.510 INFO:teuthology.orchestra.run.trial012.stdout:yes 2026-02-13T21:10:10.511 DEBUG:teuthology.orchestra.run.trial012:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T21:10:10.575 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial012 2026-02-13T21:10:10.575 DEBUG:teuthology.orchestra.run.trial012:> sudo bash -c ' 2026-02-13T21:10:10.575 DEBUG:teuthology.orchestra.run.trial012:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-13T21:10:10.575 DEBUG:teuthology.orchestra.run.trial012:> ' 2026-02-13T21:10:37.281 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-13T21:10:37.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-13T21:10:37.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T21:10:40.618 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-13T21:10:40.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-13T21:10:40.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T21:10:51.549 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.90 2026-02-13T21:10:54.877 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.12 2026-02-13T21:11:00.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-13T21:11:00.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T21:11:03.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-13T21:11:03.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T21:11:36.464 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-13T21:11:36.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-13T21:11:36.692 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-677.el9.x86_64"... 2026-02-13T21:11:36.692 DEBUG:teuthology.orchestra.run.trial090:> uname -r 2026-02-13T21:11:36.745 INFO:teuthology.orchestra.run.trial090.stdout:5.14.0-677.el9.x86_64 2026-02-13T21:11:36.746 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T21:11:36.746 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T21:11:36.746 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T21:11:37.747 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-13T21:11:37.748 DEBUG:teuthology.orchestra.run.trial090:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T21:11:37.778 INFO:teuthology.orchestra.run.trial090.stdout:ttyS1 2026-02-13T21:11:37.815 DEBUG:teuthology.parallel:result is None 2026-02-13T21:11:40.068 DEBUG:teuthology.orchestra.run.trial012:> true 2026-02-13T21:11:40.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-13T21:11:40.208 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-677.el9.x86_64"... 2026-02-13T21:11:40.209 DEBUG:teuthology.orchestra.run.trial012:> uname -r 2026-02-13T21:11:40.264 INFO:teuthology.orchestra.run.trial012.stdout:5.14.0-677.el9.x86_64 2026-02-13T21:11:40.265 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T21:11:40.265 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T21:11:40.265 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T21:11:41.265 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-13T21:11:41.266 DEBUG:teuthology.orchestra.run.trial012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T21:11:41.296 INFO:teuthology.orchestra.run.trial012.stdout:ttyS1 2026-02-13T21:11:41.319 DEBUG:teuthology.parallel:result is None 2026-02-13T21:11:41.319 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T21:11:41.331 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T21:11:41.331 DEBUG:teuthology.orchestra.run.trial012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T21:11:41.361 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T21:11:41.381 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T21:11:41.393 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T21:11:41.407 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T21:11:41.408 DEBUG:teuthology.orchestra.run.trial012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T21:11:41.417 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T21:11:41.449 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T21:11:41.461 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T21:11:41.462 DEBUG:teuthology.orchestra.run.trial012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T21:11:41.473 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T21:11:41.495 INFO:teuthology.orchestra.run.trial012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T21:11:41.504 INFO:teuthology.orchestra.run.trial012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T21:11:41.506 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T21:11:41.515 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T21:11:41.517 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T21:11:41.529 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T21:11:41.530 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T21:11:41.547 DEBUG:teuthology.orchestra.run.trial090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T21:11:41.583 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T21:11:41.600 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T21:11:41.600 DEBUG:teuthology.orchestra.run.trial012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T21:11:41.612 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T21:11:41.641 DEBUG:teuthology.orchestra.run.trial012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T21:11:41.788 DEBUG:teuthology.orchestra.run.trial012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T21:11:41.814 DEBUG:teuthology.orchestra.run.trial012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T21:11:41.956 DEBUG:teuthology.orchestra.run.trial012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T21:11:41.981 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:11:41.981 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T21:11:42.046 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T21:11:42.167 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T21:11:42.193 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T21:11:42.345 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T21:11:42.370 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:11:42.370 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T21:11:42.434 DEBUG:teuthology.orchestra.run.trial012:> sudo service rsyslog restart 2026-02-13T21:11:42.437 DEBUG:teuthology.orchestra.run.trial090:> sudo service rsyslog restart 2026-02-13T21:11:42.464 INFO:teuthology.orchestra.run.trial012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T21:11:42.502 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T21:11:42.993 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T21:11:43.005 INFO:teuthology.task.internal:Starting timer... 2026-02-13T21:11:43.006 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T21:11:43.028 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T21:11:43.045 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-13T21:11:43.046 DEBUG:teuthology.orchestra.run.trial012:> sudo service auditd rotate 2026-02-13T21:11:43.074 INFO:teuthology.orchestra.run.trial012.stdout:Rotating logs: 2026-02-13T21:11:43.075 DEBUG:teuthology.orchestra.run.trial090:> sudo service auditd rotate 2026-02-13T21:11:43.105 INFO:teuthology.orchestra.run.trial090.stdout:Rotating logs: 2026-02-13T21:11:43.107 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T21:11:43.107 DEBUG:teuthology.orchestra.run.trial012:> /usr/sbin/getenforce 2026-02-13T21:11:43.131 INFO:teuthology.orchestra.run.trial012.stdout:Permissive 2026-02-13T21:11:43.131 DEBUG:teuthology.orchestra.run.trial090:> /usr/sbin/getenforce 2026-02-13T21:11:43.164 INFO:teuthology.orchestra.run.trial090.stdout:Permissive 2026-02-13T21:11:43.165 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial012.front.sepia.ceph.com': 'permissive', 'ubuntu@trial090.front.sepia.ceph.com': 'permissive'} 2026-02-13T21:11:43.165 DEBUG:teuthology.orchestra.run.trial012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T21:11:43.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T21:11:43.197 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T21:11:43.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T21:11:43.229 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T21:11:43.229 DEBUG:teuthology.orchestra.run.trial012:> sudo /usr/sbin/setenforce permissive 2026-02-13T21:11:43.261 DEBUG:teuthology.orchestra.run.trial090:> sudo /usr/sbin/setenforce permissive 2026-02-13T21:11:43.293 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T21:11:43.308 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T21:11:43.320 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T21:11:43.321 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial012.front.sepia.ceph.com,trial090.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T21:14:26.298 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial012.front.sepia.ceph.com'), Remote(name='ubuntu@trial090.front.sepia.ceph.com')] 2026-02-13T21:14:26.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-13T21:14:26.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T21:14:26.413 DEBUG:teuthology.orchestra.run.trial012:> true 2026-02-13T21:14:26.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-13T21:14:26.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-13T21:14:26.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T21:14:26.576 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-13T21:14:26.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-13T21:14:26.655 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T21:14:26.669 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T21:14:26.669 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T21:14:26.669 DEBUG:teuthology.orchestra.run.trial012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T21:14:26.671 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T21:14:26.672 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T21:14:26.697 INFO:teuthology.orchestra.run.trial012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T21:14:26.710 INFO:teuthology.orchestra.run.trial012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T21:14:26.721 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T21:14:26.730 INFO:teuthology.orchestra.run.trial012.stderr:sudo: ntpd: command not found 2026-02-13T21:14:26.734 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T21:14:26.739 INFO:teuthology.orchestra.run.trial012.stdout:506 Cannot talk to daemon 2026-02-13T21:14:26.750 INFO:teuthology.orchestra.run.trial012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T21:14:26.754 INFO:teuthology.orchestra.run.trial090.stderr:sudo: ntpd: command not found 2026-02-13T21:14:26.761 INFO:teuthology.orchestra.run.trial012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T21:14:26.764 INFO:teuthology.orchestra.run.trial090.stdout:506 Cannot talk to daemon 2026-02-13T21:14:26.777 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T21:14:26.788 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T21:14:26.804 INFO:teuthology.orchestra.run.trial012.stderr:bash: line 1: ntpq: command not found 2026-02-13T21:14:26.806 INFO:teuthology.orchestra.run.trial012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T21:14:26.806 INFO:teuthology.orchestra.run.trial012.stdout:=============================================================================== 2026-02-13T21:14:26.807 INFO:teuthology.orchestra.run.trial012.stdout:^? 96-19-94-82.cpe.sparklig> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T21:14:26.807 INFO:teuthology.orchestra.run.trial012.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T21:14:26.807 INFO:teuthology.orchestra.run.trial012.stdout:^? hou1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T21:14:26.807 INFO:teuthology.orchestra.run.trial012.stdout:^? kjsl-fmt2-net.fmt2.kjsl.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T21:14:26.839 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-13T21:14:26.842 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T21:14:26.842 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-13T21:14:26.842 INFO:teuthology.orchestra.run.trial090.stdout:^? 209.205.228.50 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T21:14:26.842 INFO:teuthology.orchestra.run.trial090.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T21:14:26.842 INFO:teuthology.orchestra.run.trial090.stdout:^? time2.lshiy.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T21:14:26.843 INFO:teuthology.orchestra.run.trial090.stdout:^? arm1.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T21:14:26.844 INFO:teuthology.run_tasks:Running task install... 2026-02-13T21:14:26.858 DEBUG:teuthology.task.install:project ceph 2026-02-13T21:14:26.858 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33'}} 2026-02-13T21:14:26.858 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33'} 2026-02-13T21:14:26.858 INFO:teuthology.task.install:Using flavor: default 2026-02-13T21:14:26.867 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T21:14:26.867 INFO:teuthology.task.install:extra packages: [] 2026-02-13T21:14:26.868 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'tag': None, 'wait_for_package': False} 2026-02-13T21:14:26.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:14:26.872 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'tag': None, 'wait_for_package': False} 2026-02-13T21:14:26.872 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:14:27.061 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/ 2026-02-13T21:14:27.061 INFO:teuthology.task.install.rpm:Package version is 20.2.0-690.g3baf6bae 2026-02-13T21:14:27.073 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/ 2026-02-13T21:14:27.073 INFO:teuthology.task.install.rpm:Package version is 20.2.0-690.g3baf6bae 2026-02-13T21:14:27.227 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T21:14:27.227 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:14:27.227 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T21:14:27.238 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T21:14:27.238 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:14:27.238 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T21:14:27.253 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-13T21:14:27.253 DEBUG:teuthology.orchestra.run.trial012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T21:14:27.263 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-13T21:14:27.263 DEBUG:teuthology.orchestra.run.trial090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T21:14:27.318 DEBUG:teuthology.orchestra.run.trial012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T21:14:27.328 DEBUG:teuthology.orchestra.run.trial090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T21:14:27.392 DEBUG:teuthology.orchestra.run.trial012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T21:14:27.399 DEBUG:teuthology.orchestra.run.trial090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T21:14:27.456 INFO:teuthology.orchestra.run.trial012.stdout:check_obsoletes = 1 2026-02-13T21:14:27.458 DEBUG:teuthology.orchestra.run.trial012:> sudo yum clean all 2026-02-13T21:14:27.462 INFO:teuthology.orchestra.run.trial090.stdout:check_obsoletes = 1 2026-02-13T21:14:27.464 DEBUG:teuthology.orchestra.run.trial090:> sudo yum clean all 2026-02-13T21:14:27.606 INFO:teuthology.orchestra.run.trial012.stdout:41 files removed 2026-02-13T21:14:27.615 INFO:teuthology.orchestra.run.trial090.stdout:41 files removed 2026-02-13T21:14:27.619 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-radosgw 2026-02-13T21:14:27.630 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-radosgw 2026-02-13T21:14:27.921 INFO:teuthology.orchestra.run.trial012.stdout:ceph packages for x86_64 564 kB/s | 89 kB 00:00 2026-02-13T21:14:27.922 INFO:teuthology.orchestra.run.trial090.stdout:ceph packages for x86_64 600 kB/s | 89 kB 00:00 2026-02-13T21:14:28.062 INFO:teuthology.orchestra.run.trial012.stdout:ceph noarch packages 162 kB/s | 19 kB 00:00 2026-02-13T21:14:28.064 INFO:teuthology.orchestra.run.trial090.stdout:ceph noarch packages 161 kB/s | 19 kB 00:00 2026-02-13T21:14:28.188 INFO:teuthology.orchestra.run.trial012.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-13T21:14:28.189 INFO:teuthology.orchestra.run.trial090.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-13T21:14:28.928 INFO:teuthology.orchestra.run.trial012.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-13T21:14:29.887 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.9 MB 00:01 2026-02-13T21:14:32.795 INFO:teuthology.orchestra.run.trial012.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 27 MB 00:03 2026-02-13T21:14:33.100 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-13T21:14:35.793 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - CRB 24 MB/s | 7.8 MB 00:00 2026-02-13T21:14:36.735 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 20 kB 00:00 2026-02-13T21:14:37.276 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 43 MB/s | 20 MB 00:00 2026-02-13T21:14:40.502 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 1.1 MB/s | 50 kB 00:00 2026-02-13T21:14:41.795 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 24 M 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout:Upgrading: 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: librados2 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 3.5 M 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: librbd1 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 2.8 M 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 5.9 M 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 24 M 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 25 k 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 867 k 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T21:14:41.797 INFO:teuthology.orchestra.run.trial090.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 251 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: librgw2 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 6.4 M 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 45 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 175 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 163 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 323 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 305 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 99 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout:Installing weak dependencies: 2026-02-13T21:14:41.798 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-daemon x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 35 k 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-proxy2 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 24 k 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout:Install 35 Packages 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout:Upgrade 2 Packages 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 79 M 2026-02-13T21:14:41.799 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:14:42.351 INFO:teuthology.orchestra.run.trial090.stdout:(1/37): ceph-base-20.2.0-690.g3baf6bae.el9.x86_ 17 MB/s | 5.9 MB 00:00 2026-02-13T21:14:42.385 INFO:teuthology.orchestra.run.trial090.stdout:(2/37): ceph-selinux-20.2.0-690.g3baf6bae.el9.x 726 kB/s | 25 kB 00:00 2026-02-13T21:14:42.426 INFO:teuthology.orchestra.run.trial090.stdout:(3/37): libcephfs-daemon-20.2.0-690.g3baf6bae.e 881 kB/s | 35 kB 00:00 2026-02-13T21:14:42.467 INFO:teuthology.orchestra.run.trial090.stdout:(4/37): libcephfs-proxy2-20.2.0-690.g3baf6bae.e 580 kB/s | 24 kB 00:00 2026-02-13T21:14:42.527 INFO:teuthology.orchestra.run.trial090.stdout:(5/37): libcephfs2-20.2.0-690.g3baf6bae.el9.x86 14 MB/s | 867 kB 00:00 2026-02-13T21:14:42.578 INFO:teuthology.orchestra.run.trial090.stdout:(6/37): libradosstriper1-20.2.0-690.g3baf6bae.e 4.9 MB/s | 251 kB 00:00 2026-02-13T21:14:42.592 INFO:teuthology.orchestra.run.trial012.stdout:CentOS Stream 9 - CRB 1.0 MB/s | 7.8 MB 00:07 2026-02-13T21:14:42.937 INFO:teuthology.orchestra.run.trial090.stdout:(7/37): librgw2-20.2.0-690.g3baf6bae.el9.x86_64 18 MB/s | 6.4 MB 00:00 2026-02-13T21:14:42.971 INFO:teuthology.orchestra.run.trial090.stdout:(8/37): python3-ceph-argparse-20.2.0-690.g3baf6 1.3 MB/s | 45 kB 00:00 2026-02-13T21:14:43.011 INFO:teuthology.orchestra.run.trial090.stdout:(9/37): python3-ceph-common-20.2.0-690.g3baf6ba 4.3 MB/s | 175 kB 00:00 2026-02-13T21:14:43.051 INFO:teuthology.orchestra.run.trial090.stdout:(10/37): python3-cephfs-20.2.0-690.g3baf6bae.el 4.0 MB/s | 163 kB 00:00 2026-02-13T21:14:43.094 INFO:teuthology.orchestra.run.trial090.stdout:(11/37): python3-rados-20.2.0-690.g3baf6bae.el9 7.3 MB/s | 323 kB 00:00 2026-02-13T21:14:43.143 INFO:teuthology.orchestra.run.trial090.stdout:(12/37): ceph-radosgw-20.2.0-690.g3baf6bae.el9. 21 MB/s | 24 MB 00:01 2026-02-13T21:14:43.145 INFO:teuthology.orchestra.run.trial090.stdout:(13/37): python3-rbd-20.2.0-690.g3baf6bae.el9.x 5.9 MB/s | 305 kB 00:00 2026-02-13T21:14:43.155 INFO:teuthology.orchestra.run.trial090.stdout:(14/37): python3-rgw-20.2.0-690.g3baf6bae.el9.x 8.3 MB/s | 99 kB 00:00 2026-02-13T21:14:43.189 INFO:teuthology.orchestra.run.trial090.stdout:(15/37): ceph-common-20.2.0-690.g3baf6bae.el9.x 20 MB/s | 24 MB 00:01 2026-02-13T21:14:43.388 INFO:teuthology.orchestra.run.trial012.stdout:CentOS Stream 9 - Extras packages 231 kB/s | 20 kB 00:00 2026-02-13T21:14:43.612 INFO:teuthology.orchestra.run.trial090.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 71 kB/s | 33 kB 00:00 2026-02-13T21:14:43.676 INFO:teuthology.orchestra.run.trial090.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.6 MB/s | 104 kB 00:00 2026-02-13T21:14:43.720 INFO:teuthology.orchestra.run.trial090.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-13T21:14:43.745 INFO:teuthology.orchestra.run.trial090.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.4 MB/s | 160 kB 00:00 2026-02-13T21:14:43.766 INFO:teuthology.orchestra.run.trial090.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-13T21:14:43.790 INFO:teuthology.orchestra.run.trial090.stdout:(21/37): pciutils-3.7.0-7.el9.x86_64.rpm 155 kB/s | 93 kB 00:00 2026-02-13T21:14:43.812 INFO:teuthology.orchestra.run.trial090.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-13T21:14:43.836 INFO:teuthology.orchestra.run.trial090.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 9.8 MB/s | 240 kB 00:00 2026-02-13T21:14:43.858 INFO:teuthology.orchestra.run.trial090.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-13T21:14:43.880 INFO:teuthology.orchestra.run.trial090.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-13T21:14:43.886 INFO:teuthology.orchestra.run.trial012.stdout:Extra Packages for Enterprise Linux 48 MB/s | 20 MB 00:00 2026-02-13T21:14:43.897 INFO:teuthology.orchestra.run.trial090.stdout:(26/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.7 MB/s | 292 kB 00:00 2026-02-13T21:14:44.311 INFO:teuthology.orchestra.run.trial090.stdout:(27/37): nvme-cli-2.13-1.el9.x86_64.rpm 972 kB/s | 1.1 MB 00:01 2026-02-13T21:14:44.406 INFO:teuthology.orchestra.run.trial090.stdout:(28/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 585 kB/s | 308 kB 00:00 2026-02-13T21:14:44.486 INFO:teuthology.orchestra.run.trial090.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 611 kB/s | 49 kB 00:00 2026-02-13T21:14:44.573 INFO:teuthology.orchestra.run.trial090.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 772 kB/s | 67 kB 00:00 2026-02-13T21:14:44.613 INFO:teuthology.orchestra.run.trial090.stdout:(31/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 82 kB/s | 25 kB 00:00 2026-02-13T21:14:44.735 INFO:teuthology.orchestra.run.trial090.stdout:(32/37): libarrow-9.0.0-15.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2026-02-13T21:14:44.816 INFO:teuthology.orchestra.run.trial090.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2026-02-13T21:14:44.870 INFO:teuthology.orchestra.run.trial090.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2026-02-13T21:14:44.935 INFO:teuthology.orchestra.run.trial090.stdout:(35/37): librados2-20.2.0-690.g3baf6bae.el9.x86 30 MB/s | 3.5 MB 00:00 2026-02-13T21:14:44.938 INFO:teuthology.orchestra.run.trial090.stdout:(36/37): re2-20211101-20.el9.x86_64.rpm 588 kB/s | 191 kB 00:00 2026-02-13T21:14:45.023 INFO:teuthology.orchestra.run.trial090.stdout:(37/37): librbd1-20.2.0-690.g3baf6bae.el9.x86_6 19 MB/s | 2.8 MB 00:00 2026-02-13T21:14:45.028 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:14:45.028 INFO:teuthology.orchestra.run.trial090.stdout:Total 24 MB/s | 79 MB 00:03 2026-02-13T21:14:45.125 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:14:45.144 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:14:45.144 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:14:45.440 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:14:45.441 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:14:45.784 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:14:45.795 INFO:teuthology.orchestra.run.trial090.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-13T21:14:45.950 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-13T21:14:45.954 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 3/39 2026-02-13T21:14:46.004 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 3/39 2026-02-13T21:14:46.005 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 4/39 2026-02-13T21:14:46.017 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 4/39 2026-02-13T21:14:46.020 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-daemon-2:20.2.0-690.g3baf6bae.el9.x86_64 5/39 2026-02-13T21:14:46.020 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-proxy2-2:20.2.0-690.g3baf6bae.el9.x86_64 6/39 2026-02-13T21:14:46.047 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-690.g3baf6bae.el9.x86_64 6/39 2026-02-13T21:14:46.049 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rados-2:20.2.0-690.g3baf6bae.el9.x86_64 7/39 2026-02-13T21:14:46.057 INFO:teuthology.orchestra.run.trial090.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-13T21:14:46.059 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-13T21:14:46.062 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-13T21:14:46.066 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-13T21:14:46.075 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-argparse-2:20.2.0-690.g3baf6bae.el9.x 12/39 2026-02-13T21:14:46.087 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cephfs-2:20.2.0-690.g3baf6bae.el9.x86_64 13/39 2026-02-13T21:14:46.087 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libradosstriper1-2:20.2.0-690.g3baf6bae.el9.x86_64 14/39 2026-02-13T21:14:46.101 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libradosstriper1-2:20.2.0-690.g3baf6bae.el9.x86_64 14/39 2026-02-13T21:14:46.135 INFO:teuthology.orchestra.run.trial090.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-13T21:14:46.141 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-13T21:14:46.149 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-13T21:14:46.151 INFO:teuthology.orchestra.run.trial090.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-13T21:14:46.155 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-13T21:14:46.280 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-13T21:14:46.281 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 21/39 2026-02-13T21:14:46.308 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 21/39 2026-02-13T21:14:46.311 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rbd-2:20.2.0-690.g3baf6bae.el9.x86_64 22/39 2026-02-13T21:14:46.319 INFO:teuthology.orchestra.run.trial090.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-13T21:14:46.598 INFO:teuthology.orchestra.run.trial090.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-13T21:14:46.599 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librgw2-2:20.2.0-690.g3baf6bae.el9.x86_64 25/39 2026-02-13T21:14:46.616 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librgw2-2:20.2.0-690.g3baf6bae.el9.x86_64 25/39 2026-02-13T21:14:46.620 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rgw-2:20.2.0-690.g3baf6bae.el9.x86_64 26/39 2026-02-13T21:14:46.625 INFO:teuthology.orchestra.run.trial090.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-13T21:14:46.627 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-13T21:14:46.628 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-13T21:14:46.647 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-13T21:14:46.763 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-13T21:14:46.765 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-13T21:14:47.038 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-13T21:14:47.038 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T21:14:47.038 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:47.055 INFO:teuthology.orchestra.run.trial012.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-13T21:14:47.079 INFO:teuthology.orchestra.run.trial090.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-13T21:14:47.081 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-common-2:20.2.0-690.g3baf6bae.el9.x86 33/39 2026-02-13T21:14:48.167 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 34/39 2026-02-13T21:14:48.170 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 34/39 2026-02-13T21:14:48.343 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:14:48.345 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:14:48.345 INFO:teuthology.orchestra.run.trial012.stdout: Package Arch Version Repository Size 2026-02-13T21:14:48.345 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:14:48.345 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:14:48.345 INFO:teuthology.orchestra.run.trial012.stdout: ceph-radosgw x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 24 M 2026-02-13T21:14:48.345 INFO:teuthology.orchestra.run.trial012.stdout:Upgrading: 2026-02-13T21:14:48.345 INFO:teuthology.orchestra.run.trial012.stdout: librados2 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 3.5 M 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: librbd1 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 2.8 M 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout:Installing dependencies: 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: ceph-base x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 5.9 M 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: ceph-common x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 24 M 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: ceph-selinux x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 25 k 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: libcephfs2 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 867 k 2026-02-13T21:14:48.346 INFO:teuthology.orchestra.run.trial012.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T21:14:48.347 INFO:teuthology.orchestra.run.trial012.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T21:14:48.347 INFO:teuthology.orchestra.run.trial012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T21:14:48.347 INFO:teuthology.orchestra.run.trial012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T21:14:48.347 INFO:teuthology.orchestra.run.trial012.stdout: libradosstriper1 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 251 k 2026-02-13T21:14:48.347 INFO:teuthology.orchestra.run.trial012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T21:14:48.347 INFO:teuthology.orchestra.run.trial012.stdout: librgw2 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 6.4 M 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: python3-ceph-argparse x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 45 k 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: python3-ceph-common x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 175 k 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: python3-cephfs x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 163 k 2026-02-13T21:14:48.348 INFO:teuthology.orchestra.run.trial012.stdout: python3-rados x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 323 k 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: python3-rbd x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 305 k 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: python3-rgw x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 99 k 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout:Installing weak dependencies: 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: libcephfs-daemon x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 35 k 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: libcephfs-proxy2 x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 24 k 2026-02-13T21:14:48.349 INFO:teuthology.orchestra.run.trial012.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-13T21:14:48.350 INFO:teuthology.orchestra.run.trial012.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T21:14:48.350 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:14:48.350 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:14:48.350 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:14:48.350 INFO:teuthology.orchestra.run.trial012.stdout:Install 35 Packages 2026-02-13T21:14:48.350 INFO:teuthology.orchestra.run.trial012.stdout:Upgrade 2 Packages 2026-02-13T21:14:48.350 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:14:48.352 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 79 M 2026-02-13T21:14:48.352 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:14:48.466 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 34/39 2026-02-13T21:14:48.469 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 35/39 2026-02-13T21:14:48.508 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 35/39 2026-02-13T21:14:48.508 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T21:14:48.508 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T21:14:48.508 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:48.511 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-selinux-2:20.2.0-690.g3baf6bae.el9.x86_64 36/39 2026-02-13T21:14:49.236 INFO:teuthology.orchestra.run.trial012.stdout:(1/37): ceph-base-20.2.0-690.g3baf6bae.el9.x86_ 13 MB/s | 5.9 MB 00:00 2026-02-13T21:14:49.282 INFO:teuthology.orchestra.run.trial012.stdout:(2/37): ceph-selinux-20.2.0-690.g3baf6bae.el9.x 553 kB/s | 25 kB 00:00 2026-02-13T21:14:49.332 INFO:teuthology.orchestra.run.trial012.stdout:(3/37): libcephfs-daemon-20.2.0-690.g3baf6bae.e 697 kB/s | 35 kB 00:00 2026-02-13T21:14:49.385 INFO:teuthology.orchestra.run.trial012.stdout:(4/37): libcephfs-proxy2-20.2.0-690.g3baf6bae.e 459 kB/s | 24 kB 00:00 2026-02-13T21:14:49.456 INFO:teuthology.orchestra.run.trial012.stdout:(5/37): libcephfs2-20.2.0-690.g3baf6bae.el9.x86 12 MB/s | 867 kB 00:00 2026-02-13T21:14:49.518 INFO:teuthology.orchestra.run.trial012.stdout:(6/37): libradosstriper1-20.2.0-690.g3baf6bae.e 4.0 MB/s | 251 kB 00:00 2026-02-13T21:14:49.816 INFO:teuthology.orchestra.run.trial012.stdout:(7/37): ceph-common-20.2.0-690.g3baf6bae.el9.x8 23 MB/s | 24 MB 00:01 2026-02-13T21:14:49.845 INFO:teuthology.orchestra.run.trial012.stdout:(8/37): librgw2-20.2.0-690.g3baf6bae.el9.x86_64 19 MB/s | 6.4 MB 00:00 2026-02-13T21:14:49.846 INFO:teuthology.orchestra.run.trial012.stdout:(9/37): python3-ceph-argparse-20.2.0-690.g3baf6 1.5 MB/s | 45 kB 00:00 2026-02-13T21:14:49.868 INFO:teuthology.orchestra.run.trial012.stdout:(10/37): python3-ceph-common-20.2.0-690.g3baf6b 7.6 MB/s | 175 kB 00:00 2026-02-13T21:14:49.871 INFO:teuthology.orchestra.run.trial012.stdout:(11/37): python3-cephfs-20.2.0-690.g3baf6bae.el 6.4 MB/s | 163 kB 00:00 2026-02-13T21:14:49.895 INFO:teuthology.orchestra.run.trial012.stdout:(12/37): python3-rados-20.2.0-690.g3baf6bae.el9 12 MB/s | 323 kB 00:00 2026-02-13T21:14:49.901 INFO:teuthology.orchestra.run.trial012.stdout:(13/37): python3-rbd-20.2.0-690.g3baf6bae.el9.x 10 MB/s | 305 kB 00:00 2026-02-13T21:14:49.921 INFO:teuthology.orchestra.run.trial012.stdout:(14/37): python3-rgw-20.2.0-690.g3baf6bae.el9.x 3.8 MB/s | 99 kB 00:00 2026-02-13T21:14:49.961 INFO:teuthology.orchestra.run.trial012.stdout:(15/37): ceph-radosgw-20.2.0-690.g3baf6bae.el9. 20 MB/s | 24 MB 00:01 2026-02-13T21:14:50.463 INFO:teuthology.orchestra.run.trial012.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 59 kB/s | 33 kB 00:00 2026-02-13T21:14:50.481 INFO:teuthology.orchestra.run.trial012.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 5.9 MB/s | 104 kB 00:00 2026-02-13T21:14:50.489 INFO:teuthology.orchestra.run.trial012.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 19 MB/s | 164 kB 00:00 2026-02-13T21:14:50.496 INFO:teuthology.orchestra.run.trial012.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 23 MB/s | 160 kB 00:00 2026-02-13T21:14:50.500 INFO:teuthology.orchestra.run.trial012.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 10 MB/s | 45 kB 00:00 2026-02-13T21:14:50.511 INFO:teuthology.orchestra.run.trial012.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 64 MB/s | 662 kB 00:00 2026-02-13T21:14:50.517 INFO:teuthology.orchestra.run.trial012.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 46 MB/s | 292 kB 00:00 2026-02-13T21:14:50.523 INFO:teuthology.orchestra.run.trial012.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 39 MB/s | 240 kB 00:00 2026-02-13T21:14:50.527 INFO:teuthology.orchestra.run.trial012.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 8.8 MB/s | 37 kB 00:00 2026-02-13T21:14:50.532 INFO:teuthology.orchestra.run.trial012.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 15 MB/s | 66 kB 00:00 2026-02-13T21:14:50.617 INFO:teuthology.orchestra.run.trial012.stdout:(26/37): pciutils-3.7.0-7.el9.x86_64.rpm 142 kB/s | 93 kB 00:00 2026-02-13T21:14:50.854 INFO:teuthology.orchestra.run.trial012.stdout:(27/37): nvme-cli-2.13-1.el9.x86_64.rpm 1.2 MB/s | 1.1 MB 00:00 2026-02-13T21:14:50.950 INFO:teuthology.orchestra.run.trial012.stdout:(28/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 736 kB/s | 308 kB 00:00 2026-02-13T21:14:51.020 INFO:teuthology.orchestra.run.trial012.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 700 kB/s | 49 kB 00:00 2026-02-13T21:14:51.059 INFO:teuthology.orchestra.run.trial012.stdout:(30/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 120 kB/s | 25 kB 00:00 2026-02-13T21:14:51.090 INFO:teuthology.orchestra.run.trial012.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 963 kB/s | 67 kB 00:00 2026-02-13T21:14:51.160 INFO:teuthology.orchestra.run.trial012.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-13T21:14:51.303 INFO:teuthology.orchestra.run.trial012.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2026-02-13T21:14:51.387 INFO:teuthology.orchestra.run.trial012.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2026-02-13T21:14:51.404 INFO:teuthology.orchestra.run.trial012.stdout:(35/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 2.4 MB/s | 838 kB 00:00 2026-02-13T21:14:51.411 INFO:teuthology.orchestra.run.trial012.stdout:(36/37): librados2-20.2.0-690.g3baf6bae.el9.x86 32 MB/s | 3.5 MB 00:00 2026-02-13T21:14:51.494 INFO:teuthology.orchestra.run.trial012.stdout:(37/37): librbd1-20.2.0-690.g3baf6bae.el9.x86_6 27 MB/s | 2.8 MB 00:00 2026-02-13T21:14:51.496 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:14:51.496 INFO:teuthology.orchestra.run.trial012.stdout:Total 25 MB/s | 79 MB 00:03 2026-02-13T21:14:51.596 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:14:51.615 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:14:51.615 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:14:51.912 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:14:51.912 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:14:52.252 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:14:52.263 INFO:teuthology.orchestra.run.trial012.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-13T21:14:52.416 INFO:teuthology.orchestra.run.trial012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-13T21:14:52.420 INFO:teuthology.orchestra.run.trial012.stdout: Upgrading : librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 3/39 2026-02-13T21:14:52.471 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 3/39 2026-02-13T21:14:52.472 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 4/39 2026-02-13T21:14:52.484 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 4/39 2026-02-13T21:14:52.486 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libcephfs-daemon-2:20.2.0-690.g3baf6bae.el9.x86_64 5/39 2026-02-13T21:14:52.487 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libcephfs-proxy2-2:20.2.0-690.g3baf6bae.el9.x86_64 6/39 2026-02-13T21:14:52.514 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-690.g3baf6bae.el9.x86_64 6/39 2026-02-13T21:14:52.516 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-rados-2:20.2.0-690.g3baf6bae.el9.x86_64 7/39 2026-02-13T21:14:52.525 INFO:teuthology.orchestra.run.trial012.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-13T21:14:52.528 INFO:teuthology.orchestra.run.trial012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-13T21:14:52.531 INFO:teuthology.orchestra.run.trial012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-13T21:14:52.535 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-13T21:14:52.544 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-ceph-argparse-2:20.2.0-690.g3baf6bae.el9.x 12/39 2026-02-13T21:14:52.556 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-cephfs-2:20.2.0-690.g3baf6bae.el9.x86_64 13/39 2026-02-13T21:14:52.557 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libradosstriper1-2:20.2.0-690.g3baf6bae.el9.x86_64 14/39 2026-02-13T21:14:52.571 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: libradosstriper1-2:20.2.0-690.g3baf6bae.el9.x86_64 14/39 2026-02-13T21:14:52.609 INFO:teuthology.orchestra.run.trial012.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-13T21:14:52.613 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-13T21:14:52.619 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-13T21:14:52.621 INFO:teuthology.orchestra.run.trial012.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-13T21:14:52.626 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-13T21:14:52.748 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-13T21:14:52.749 INFO:teuthology.orchestra.run.trial012.stdout: Upgrading : librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 21/39 2026-02-13T21:14:52.775 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 21/39 2026-02-13T21:14:52.777 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-rbd-2:20.2.0-690.g3baf6bae.el9.x86_64 22/39 2026-02-13T21:14:52.783 INFO:teuthology.orchestra.run.trial012.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-13T21:14:53.054 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-selinux-2:20.2.0-690.g3baf6bae.el9.x86_64 36/39 2026-02-13T21:14:53.055 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /sys 2026-02-13T21:14:53.055 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /proc 2026-02-13T21:14:53.055 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /mnt 2026-02-13T21:14:53.055 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /var/tmp 2026-02-13T21:14:53.055 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /home 2026-02-13T21:14:53.055 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /root 2026-02-13T21:14:53.055 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /tmp 2026-02-13T21:14:53.055 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:53.059 INFO:teuthology.orchestra.run.trial012.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-13T21:14:53.060 INFO:teuthology.orchestra.run.trial012.stdout: Installing : librgw2-2:20.2.0-690.g3baf6bae.el9.x86_64 25/39 2026-02-13T21:14:53.076 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: librgw2-2:20.2.0-690.g3baf6bae.el9.x86_64 25/39 2026-02-13T21:14:53.081 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-rgw-2:20.2.0-690.g3baf6bae.el9.x86_64 26/39 2026-02-13T21:14:53.086 INFO:teuthology.orchestra.run.trial012.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-13T21:14:53.089 INFO:teuthology.orchestra.run.trial012.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-13T21:14:53.089 INFO:teuthology.orchestra.run.trial012.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-13T21:14:53.107 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-13T21:14:53.223 INFO:teuthology.orchestra.run.trial012.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-13T21:14:53.225 INFO:teuthology.orchestra.run.trial012.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-13T21:14:53.499 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-13T21:14:53.499 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T21:14:53.499 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:14:53.542 INFO:teuthology.orchestra.run.trial012.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-13T21:14:53.544 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-ceph-common-2:20.2.0-690.g3baf6bae.el9.x86 33/39 2026-02-13T21:14:54.084 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-radosgw-2:20.2.0-690.g3baf6bae.el9.x86_64 37/39 2026-02-13T21:14:54.107 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-690.g3baf6bae.el9.x86_64 37/39 2026-02-13T21:14:54.107 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:14:54.107 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T21:14:54.107 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T21:14:54.107 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T21:14:54.107 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:54.109 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-13T21:14:54.120 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-13T21:14:54.120 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T21:14:54.177 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T21:14:54.178 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'qat' with GID 992. 2026-02-13T21:14:54.178 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:54.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 1/39 2026-02-13T21:14:54.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 2/39 2026-02-13T21:14:54.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-radosgw-2:20.2.0-690.g3baf6bae.el9.x86_64 3/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-selinux-2:20.2.0-690.g3baf6bae.el9.x86_64 4/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-daemon-2:20.2.0-690.g3baf6bae.el9.x86_64 5/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-proxy2-2:20.2.0-690.g3baf6bae.el9.x86_64 6/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 7/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libradosstriper1-2:20.2.0-690.g3baf6bae.el9.x86_64 8/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librgw2-2:20.2.0-690.g3baf6bae.el9.x86_64 9/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ceph-argparse-2:20.2.0-690.g3baf6bae.el9.x 10/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ceph-common-2:20.2.0-690.g3baf6bae.el9.x86 11/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cephfs-2:20.2.0-690.g3baf6bae.el9.x86_64 12/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rados-2:20.2.0-690.g3baf6bae.el9.x86_64 13/39 2026-02-13T21:14:54.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rbd-2:20.2.0-690.g3baf6bae.el9.x86_64 14/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rgw-2:20.2.0-690.g3baf6bae.el9.x86_64 15/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-13T21:14:54.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 36/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-13T21:14:54.498 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 38/39 2026-02-13T21:14:54.556 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T21:14:54.556 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout:Upgraded: 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T21:14:54.557 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-daemon-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-proxy2-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: librgw2-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.558 INFO:teuthology.orchestra.run.trial090.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:14:54.559 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T21:14:54.560 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T21:14:54.560 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T21:14:54.560 INFO:teuthology.orchestra.run.trial090.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T21:14:54.560 INFO:teuthology.orchestra.run.trial090.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T21:14:54.560 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:54.560 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:14:54.602 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-test 2026-02-13T21:14:54.621 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 34/39 2026-02-13T21:14:54.624 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 34/39 2026-02-13T21:14:54.908 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:14 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:14:54.924 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 34/39 2026-02-13T21:14:54.927 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 35/39 2026-02-13T21:14:54.968 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 35/39 2026-02-13T21:14:54.969 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T21:14:54.969 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T21:14:54.969 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:14:54.972 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-selinux-2:20.2.0-690.g3baf6bae.el9.x86_64 36/39 2026-02-13T21:14:54.996 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:14:54.997 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:14:54.997 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 84 M 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 164 k 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:54.998 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:14:54.999 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:14:54.999 INFO:teuthology.orchestra.run.trial090.stdout:Install 5 Packages 2026-02-13T21:14:54.999 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:14:54.999 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 85 M 2026-02-13T21:14:54.999 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 364 M 2026-02-13T21:14:54.999 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:14:55.152 INFO:teuthology.orchestra.run.trial090.stdout:(1/5): libcephsqlite-20.2.0-690.g3baf6bae.el9.x 1.7 MB/s | 164 kB 00:00 2026-02-13T21:14:55.819 INFO:teuthology.orchestra.run.trial090.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 309 kB/s | 233 kB 00:00 2026-02-13T21:14:55.941 INFO:teuthology.orchestra.run.trial090.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 384 kB/s | 303 kB 00:00 2026-02-13T21:14:56.439 INFO:teuthology.orchestra.run.trial090.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2026-02-13T21:14:56.719 INFO:teuthology.orchestra.run.trial090.stdout:(5/5): ceph-test-20.2.0-690.g3baf6bae.el9.x86_6 51 MB/s | 84 MB 00:01 2026-02-13T21:14:56.720 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:14:56.720 INFO:teuthology.orchestra.run.trial090.stdout:Total 49 MB/s | 85 MB 00:01 2026-02-13T21:14:56.746 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:14:56.756 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:14:56.756 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:14:57.044 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:14:57.045 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:14:57.357 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:14:57.362 INFO:teuthology.orchestra.run.trial090.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-13T21:14:57.366 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-13T21:14:57.377 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-13T21:14:57.377 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephsqlite-2:20.2.0-690.g3baf6bae.el9.x86_64 4/5 2026-02-13T21:14:59.468 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-selinux-2:20.2.0-690.g3baf6bae.el9.x86_64 36/39 2026-02-13T21:14:59.468 INFO:teuthology.orchestra.run.trial012.stdout:skipping the directory /sys 2026-02-13T21:14:59.468 INFO:teuthology.orchestra.run.trial012.stdout:skipping the directory /proc 2026-02-13T21:14:59.468 INFO:teuthology.orchestra.run.trial012.stdout:skipping the directory /mnt 2026-02-13T21:14:59.468 INFO:teuthology.orchestra.run.trial012.stdout:skipping the directory /var/tmp 2026-02-13T21:14:59.468 INFO:teuthology.orchestra.run.trial012.stdout:skipping the directory /home 2026-02-13T21:14:59.468 INFO:teuthology.orchestra.run.trial012.stdout:skipping the directory /root 2026-02-13T21:14:59.468 INFO:teuthology.orchestra.run.trial012.stdout:skipping the directory /tmp 2026-02-13T21:14:59.469 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:00.493 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-radosgw-2:20.2.0-690.g3baf6bae.el9.x86_64 37/39 2026-02-13T21:15:00.518 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-690.g3baf6bae.el9.x86_64 37/39 2026-02-13T21:15:00.518 INFO:teuthology.orchestra.run.trial012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:00.518 INFO:teuthology.orchestra.run.trial012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T21:15:00.518 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T21:15:00.519 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T21:15:00.519 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:00.520 INFO:teuthology.orchestra.run.trial012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-13T21:15:00.532 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-13T21:15:00.532 INFO:teuthology.orchestra.run.trial012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T21:15:00.588 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T21:15:00.588 INFO:teuthology.orchestra.run.trial012.stdout:Creating group 'qat' with GID 992. 2026-02-13T21:15:00.589 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:00.898 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 1/39 2026-02-13T21:15:00.898 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 2/39 2026-02-13T21:15:00.898 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-radosgw-2:20.2.0-690.g3baf6bae.el9.x86_64 3/39 2026-02-13T21:15:00.898 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-selinux-2:20.2.0-690.g3baf6bae.el9.x86_64 4/39 2026-02-13T21:15:00.898 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libcephfs-daemon-2:20.2.0-690.g3baf6bae.el9.x86_64 5/39 2026-02-13T21:15:00.898 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libcephfs-proxy2-2:20.2.0-690.g3baf6bae.el9.x86_64 6/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 7/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libradosstriper1-2:20.2.0-690.g3baf6bae.el9.x86_64 8/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : librgw2-2:20.2.0-690.g3baf6bae.el9.x86_64 9/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-ceph-argparse-2:20.2.0-690.g3baf6bae.el9.x 10/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-ceph-common-2:20.2.0-690.g3baf6bae.el9.x86 11/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-cephfs-2:20.2.0-690.g3baf6bae.el9.x86_64 12/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-rados-2:20.2.0-690.g3baf6bae.el9.x86_64 13/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-rbd-2:20.2.0-690.g3baf6bae.el9.x86_64 14/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-rgw-2:20.2.0-690.g3baf6bae.el9.x86_64 15/39 2026-02-13T21:15:00.899 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-13T21:15:00.900 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-13T21:15:00.901 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-13T21:15:00.902 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 36/39 2026-02-13T21:15:00.902 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-13T21:15:00.902 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 38/39 2026-02-13T21:15:00.961 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T21:15:00.961 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:00.961 INFO:teuthology.orchestra.run.trial012.stdout:Upgraded: 2026-02-13T21:15:00.961 INFO:teuthology.orchestra.run.trial012.stdout: librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.961 INFO:teuthology.orchestra.run.trial012.stdout: librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.961 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: ceph-radosgw-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: ceph-selinux-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: libcephfs-daemon-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: libcephfs-proxy2-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.962 INFO:teuthology.orchestra.run.trial012.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: libradosstriper1-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: librgw2-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-13T21:15:00.963 INFO:teuthology.orchestra.run.trial012.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: python3-ceph-argparse-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: python3-ceph-common-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: python3-cephfs-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: python3-rados-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: python3-rbd-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: python3-rgw-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T21:15:00.964 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:00.965 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:01.005 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-test 2026-02-13T21:15:01.252 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephsqlite-2:20.2.0-690.g3baf6bae.el9.x86_64 4/5 2026-02-13T21:15:01.270 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-test-2:20.2.0-690.g3baf6bae.el9.x86_64 5/5 2026-02-13T21:15:01.304 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:00:14 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:01.388 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:01.389 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout: Package Arch Version Repository Size 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout: ceph-test x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 84 M 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout:Installing dependencies: 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout: libcephsqlite x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 164 k 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:01.390 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:15:01.391 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:01.391 INFO:teuthology.orchestra.run.trial012.stdout:Install 5 Packages 2026-02-13T21:15:01.391 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:01.391 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 85 M 2026-02-13T21:15:01.391 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 364 M 2026-02-13T21:15:01.391 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:15:01.550 INFO:teuthology.orchestra.run.trial012.stdout:(1/5): libcephsqlite-20.2.0-690.g3baf6bae.el9.x 1.6 MB/s | 164 kB 00:00 2026-02-13T21:15:01.602 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-test-2:20.2.0-690.g3baf6bae.el9.x86_64 5/5 2026-02-13T21:15:01.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-test-2:20.2.0-690.g3baf6bae.el9.x86_64 1/5 2026-02-13T21:15:01.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephsqlite-2:20.2.0-690.g3baf6bae.el9.x86_64 2/5 2026-02-13T21:15:01.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-13T21:15:01.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-13T21:15:01.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-13T21:15:01.655 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:01.655 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:01.655 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:01.655 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:01.656 INFO:teuthology.orchestra.run.trial090.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T21:15:01.656 INFO:teuthology.orchestra.run.trial090.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T21:15:01.656 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T21:15:01.656 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:01.656 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:01.691 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph 2026-02-13T21:15:01.970 INFO:teuthology.orchestra.run.trial012.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 450 kB/s | 233 kB 00:00 2026-02-13T21:15:01.985 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:21 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:02.067 INFO:teuthology.orchestra.run.trial012.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 653 kB/s | 64 kB 00:00 2026-02-13T21:15:02.071 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:02.073 INFO:teuthology.orchestra.run.trial090.stdout:====================================================================================== 2026-02-13T21:15:02.073 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-13T21:15:02.073 INFO:teuthology.orchestra.run.trial090.stdout:====================================================================================== 2026-02-13T21:15:02.073 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ceph x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 6.5 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 43 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 2.3 M 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 962 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 290 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 5.1 M 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 17 M 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 17 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: cephadm noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 1.0 M 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T21:15:02.074 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T21:15:02.075 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T21:15:02.076 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout:Installing weak dependencies: 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 173 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 11 M 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 7.4 M 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 22 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 50 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 297 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-13T21:15:02.077 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-13T21:15:02.078 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:02.078 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:15:02.078 INFO:teuthology.orchestra.run.trial090.stdout:====================================================================================== 2026-02-13T21:15:02.078 INFO:teuthology.orchestra.run.trial090.stdout:Install 95 Packages 2026-02-13T21:15:02.078 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:02.078 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 101 M 2026-02-13T21:15:02.078 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 561 M 2026-02-13T21:15:02.078 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:15:02.092 INFO:teuthology.orchestra.run.trial012.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 558 kB/s | 303 kB 00:00 2026-02-13T21:15:02.855 INFO:teuthology.orchestra.run.trial090.stdout:(1/95): ceph-20.2.0-690.g3baf6bae.el9.x86_64.rp 31 kB/s | 6.5 kB 00:00 2026-02-13T21:15:03.100 INFO:teuthology.orchestra.run.trial090.stdout:(2/95): ceph-mgr-20.2.0-690.g3baf6bae.el9.x86_6 2.1 MB/s | 962 kB 00:00 2026-02-13T21:15:03.112 INFO:teuthology.orchestra.run.trial012.stdout:(5/5): ceph-test-20.2.0-690.g3baf6bae.el9.x86_6 51 MB/s | 84 MB 00:01 2026-02-13T21:15:03.114 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:03.114 INFO:teuthology.orchestra.run.trial012.stdout:Total 49 MB/s | 85 MB 00:01 2026-02-13T21:15:03.140 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:15:03.149 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:15:03.149 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:15:03.197 INFO:teuthology.orchestra.run.trial090.stdout:(3/95): ceph-mds-20.2.0-690.g3baf6bae.el9.x86_6 4.2 MB/s | 2.3 MB 00:00 2026-02-13T21:15:03.208 INFO:teuthology.orchestra.run.trial090.stdout:(4/95): ceph-grafana-dashboards-20.2.0-690.g3ba 3.7 MB/s | 43 kB 00:00 2026-02-13T21:15:03.221 INFO:teuthology.orchestra.run.trial090.stdout:(5/95): ceph-mgr-cephadm-20.2.0-690.g3baf6bae.e 14 MB/s | 173 kB 00:00 2026-02-13T21:15:03.436 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:15:03.436 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:15:03.437 INFO:teuthology.orchestra.run.trial090.stdout:(6/95): ceph-mon-20.2.0-690.g3baf6bae.el9.x86_6 8.7 MB/s | 5.1 MB 00:00 2026-02-13T21:15:03.748 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:15:03.752 INFO:teuthology.orchestra.run.trial090.stdout:(7/95): ceph-mgr-dashboard-20.2.0-690.g3baf6bae 20 MB/s | 11 MB 00:00 2026-02-13T21:15:03.754 INFO:teuthology.orchestra.run.trial012.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-13T21:15:03.758 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-13T21:15:03.767 INFO:teuthology.orchestra.run.trial012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-13T21:15:03.767 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libcephsqlite-2:20.2.0-690.g3baf6bae.el9.x86_64 4/5 2026-02-13T21:15:03.770 INFO:teuthology.orchestra.run.trial090.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-690.g3baf6bae 1.2 MB/s | 22 kB 00:00 2026-02-13T21:15:03.800 INFO:teuthology.orchestra.run.trial090.stdout:(9/95): ceph-mgr-modules-core-20.2.0-690.g3baf6 9.4 MB/s | 290 kB 00:00 2026-02-13T21:15:03.826 INFO:teuthology.orchestra.run.trial090.stdout:(10/95): ceph-mgr-rook-20.2.0-690.g3baf6bae.el9 1.9 MB/s | 50 kB 00:00 2026-02-13T21:15:03.860 INFO:teuthology.orchestra.run.trial090.stdout:(11/95): ceph-osd-20.2.0-690.g3baf6bae.el9.x86_ 22 MB/s | 17 MB 00:00 2026-02-13T21:15:03.860 INFO:teuthology.orchestra.run.trial090.stdout:(12/95): ceph-prometheus-alerts-20.2.0-690.g3ba 515 kB/s | 17 kB 00:00 2026-02-13T21:15:03.880 INFO:teuthology.orchestra.run.trial090.stdout:(13/95): ceph-mgr-diskprediction-local-20.2.0-6 17 MB/s | 7.4 MB 00:00 2026-02-13T21:15:03.881 INFO:teuthology.orchestra.run.trial090.stdout:(14/95): ceph-volume-20.2.0-690.g3baf6bae.el9.n 14 MB/s | 297 kB 00:00 2026-02-13T21:15:03.893 INFO:teuthology.orchestra.run.trial090.stdout:(15/95): cephadm-20.2.0-690.g3baf6bae.el9.noarc 30 MB/s | 1.0 MB 00:00 2026-02-13T21:15:03.949 INFO:teuthology.orchestra.run.trial090.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 597 kB/s | 40 kB 00:00 2026-02-13T21:15:03.957 INFO:teuthology.orchestra.run.trial090.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 1.1 MB/s | 72 kB 00:00 2026-02-13T21:15:03.992 INFO:teuthology.orchestra.run.trial090.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.1 MB/s | 350 kB 00:00 2026-02-13T21:15:04.001 INFO:teuthology.orchestra.run.trial090.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 4.1 MB/s | 184 kB 00:00 2026-02-13T21:15:04.016 INFO:teuthology.orchestra.run.trial090.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 10 MB/s | 253 kB 00:00 2026-02-13T21:15:04.035 INFO:teuthology.orchestra.run.trial090.stdout:(21/95): libgfortran-11.5.0-14.el9.x86_64.rpm 9.0 MB/s | 794 kB 00:00 2026-02-13T21:15:04.039 INFO:teuthology.orchestra.run.trial090.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-13T21:15:04.059 INFO:teuthology.orchestra.run.trial090.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 5.5 MB/s | 135 kB 00:00 2026-02-13T21:15:04.063 INFO:teuthology.orchestra.run.trial090.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 6.2 MB/s | 150 kB 00:00 2026-02-13T21:15:04.082 INFO:teuthology.orchestra.run.trial090.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 5.6 MB/s | 126 kB 00:00 2026-02-13T21:15:04.086 INFO:teuthology.orchestra.run.trial090.stdout:(26/95): python3-cryptography-36.0.1-5.el9.x86_ 15 MB/s | 1.2 MB 00:00 2026-02-13T21:15:04.089 INFO:teuthology.orchestra.run.trial090.stdout:(27/95): python3-urllib3-1.26.5-7.el9.noarch.rp 8.3 MB/s | 218 kB 00:00 2026-02-13T21:15:04.105 INFO:teuthology.orchestra.run.trial090.stdout:(28/95): unzip-6.0-59.el9.x86_64.rpm 7.6 MB/s | 182 kB 00:00 2026-02-13T21:15:04.110 INFO:teuthology.orchestra.run.trial090.stdout:(29/95): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-13T21:15:06.587 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] flexiblas-3.0.4-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/flexiblas-3.0.4-8.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T21:15:06.587 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] flexiblas-openblas-openmp-3.0.4-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/flexiblas-openblas-openmp-3.0.4-8.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T21:15:06.587 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] flexiblas-netlib-3.0.4-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/flexiblas-netlib-3.0.4-8.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T21:15:07.626 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: libcephsqlite-2:20.2.0-690.g3baf6bae.el9.x86_64 4/5 2026-02-13T21:15:07.644 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-test-2:20.2.0-690.g3baf6bae.el9.x86_64 5/5 2026-02-13T21:15:07.992 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-test-2:20.2.0-690.g3baf6bae.el9.x86_64 5/5 2026-02-13T21:15:07.992 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-test-2:20.2.0-690.g3baf6bae.el9.x86_64 1/5 2026-02-13T21:15:07.992 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libcephsqlite-2:20.2.0-690.g3baf6bae.el9.x86_64 2/5 2026-02-13T21:15:07.992 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-13T21:15:07.992 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout: ceph-test-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout: libcephsqlite-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:08.046 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:08.082 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph 2026-02-13T21:15:08.383 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:00:21 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:08.470 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout:====================================================================================== 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: Package Arch Version Repository Size 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout:====================================================================================== 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ceph x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 6.5 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout:Installing dependencies: 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ceph-grafana-dashboards noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 43 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mds x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 2.3 M 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 962 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-modules-core noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 290 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mon x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 5.1 M 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ceph-osd x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 17 M 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ceph-prometheus-alerts noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 17 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: cephadm noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 1.0 M 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T21:15:08.473 INFO:teuthology.orchestra.run.trial012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T21:15:08.474 INFO:teuthology.orchestra.run.trial012.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout:Installing weak dependencies: 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-cephadm noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 173 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-dashboard noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 11 M 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 7.4 M 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 22 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-rook noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 50 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: ceph-volume noarch 2:20.2.0-690.g3baf6bae.el9 ceph-noarch 297 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout:====================================================================================== 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout:Install 95 Packages 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 101 M 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 561 M 2026-02-13T21:15:08.475 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:15:09.037 INFO:teuthology.orchestra.run.trial012.stdout:(1/95): ceph-20.2.0-690.g3baf6bae.el9.x86_64.rp 112 kB/s | 6.5 kB 00:00 2026-02-13T21:15:09.124 INFO:teuthology.orchestra.run.trial012.stdout:(2/95): ceph-mgr-20.2.0-690.g3baf6bae.el9.x86_6 6.5 MB/s | 962 kB 00:00 2026-02-13T21:15:09.149 INFO:teuthology.orchestra.run.trial012.stdout:(3/95): ceph-mds-20.2.0-690.g3baf6bae.el9.x86_6 14 MB/s | 2.3 MB 00:00 2026-02-13T21:15:09.183 INFO:teuthology.orchestra.run.trial012.stdout:(4/95): ceph-grafana-dashboards-20.2.0-690.g3ba 1.3 MB/s | 43 kB 00:00 2026-02-13T21:15:09.220 INFO:teuthology.orchestra.run.trial012.stdout:(5/95): ceph-mgr-cephadm-20.2.0-690.g3baf6bae.e 4.5 MB/s | 173 kB 00:00 2026-02-13T21:15:09.304 INFO:teuthology.orchestra.run.trial012.stdout:(6/95): ceph-mon-20.2.0-690.g3baf6bae.el9.x86_6 19 MB/s | 5.1 MB 00:00 2026-02-13T21:15:09.715 INFO:teuthology.orchestra.run.trial012.stdout:(7/95): ceph-mgr-dashboard-20.2.0-690.g3baf6bae 21 MB/s | 11 MB 00:00 2026-02-13T21:15:09.737 INFO:teuthology.orchestra.run.trial012.stdout:(8/95): ceph-mgr-diskprediction-local-20.2.0-69 17 MB/s | 7.4 MB 00:00 2026-02-13T21:15:09.737 INFO:teuthology.orchestra.run.trial012.stdout:(9/95): ceph-mgr-k8sevents-20.2.0-690.g3baf6bae 990 kB/s | 22 kB 00:00 2026-02-13T21:15:09.759 INFO:teuthology.orchestra.run.trial012.stdout:(10/95): ceph-mgr-modules-core-20.2.0-690.g3baf 13 MB/s | 290 kB 00:00 2026-02-13T21:15:09.760 INFO:teuthology.orchestra.run.trial012.stdout:(11/95): ceph-mgr-rook-20.2.0-690.g3baf6bae.el9 2.1 MB/s | 50 kB 00:00 2026-02-13T21:15:09.777 INFO:teuthology.orchestra.run.trial012.stdout:(12/95): ceph-prometheus-alerts-20.2.0-690.g3ba 963 kB/s | 17 kB 00:00 2026-02-13T21:15:09.783 INFO:teuthology.orchestra.run.trial012.stdout:(13/95): ceph-volume-20.2.0-690.g3baf6bae.el9.n 13 MB/s | 297 kB 00:00 2026-02-13T21:15:09.790 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] flexiblas-3.0.4-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/flexiblas-3.0.4-8.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:09.790 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] flexiblas-openblas-openmp-3.0.4-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/flexiblas-openblas-openmp-3.0.4-8.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:09.790 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] flexiblas-netlib-3.0.4-8.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/flexiblas-netlib-3.0.4-8.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:09.835 INFO:teuthology.orchestra.run.trial012.stdout:(14/95): cephadm-20.2.0-690.g3baf6bae.el9.noarc 17 MB/s | 1.0 MB 00:00 2026-02-13T21:15:09.861 INFO:teuthology.orchestra.run.trial012.stdout:(15/95): ceph-osd-20.2.0-690.g3baf6bae.el9.x86_ 23 MB/s | 17 MB 00:00 2026-02-13T21:15:10.041 INFO:teuthology.orchestra.run.trial090.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-8.el9. 3.1 kB/s | 18 kB 00:05 2026-02-13T21:15:10.070 INFO:teuthology.orchestra.run.trial090.stdout:(31/95): flexiblas-3.0.4-8.el9.x86_64.rpm 5.5 kB/s | 33 kB 00:05 2026-02-13T21:15:10.615 INFO:teuthology.orchestra.run.trial090.stdout:(32/95): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 470 kB/s | 3.0 MB 00:06 2026-02-13T21:15:12.816 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] libstoragemgmt-1.10.1-1.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libstoragemgmt-1.10.1-1.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:12.817 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] lua-5.4.4-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/lua-5.4.4-4.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:12.817 INFO:teuthology.orchestra.run.trial090.stdout:[MIRROR] openblas-0.3.29-1.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.29-1.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:12.901 INFO:teuthology.orchestra.run.trial090.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 67 kB/s | 188 kB 00:02 2026-02-13T21:15:12.988 INFO:teuthology.orchestra.run.trial090.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 18 kB/s | 42 kB 00:02 2026-02-13T21:15:13.064 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] cryptsetup-2.8.1-2.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/cryptsetup-2.8.1-2.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T21:15:13.064 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] ledmon-libs-1.1.0-3.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/ledmon-libs-1.1.0-3.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T21:15:13.064 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] libconfig-1.7.2-9.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libconfig-1.7.2-9.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T21:15:13.118 INFO:teuthology.orchestra.run.trial090.stdout:(35/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 24 MB/s | 5.3 MB 00:00 2026-02-13T21:15:13.150 INFO:teuthology.orchestra.run.trial090.stdout:(36/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 79 kB/s | 246 kB 00:03 2026-02-13T21:15:13.283 INFO:teuthology.orchestra.run.trial090.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2026-02-13T21:15:13.317 INFO:teuthology.orchestra.run.trial090.stdout:(38/95): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2026-02-13T21:15:13.400 INFO:teuthology.orchestra.run.trial090.stdout:(39/95): python3-jmespath-1.0.1-1.el9.noarch.rp 572 kB/s | 48 kB 00:00 2026-02-13T21:15:13.411 INFO:teuthology.orchestra.run.trial090.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.9 MB/s | 249 kB 00:00 2026-02-13T21:15:13.416 INFO:teuthology.orchestra.run.trial090.stdout:(41/95): protobuf-3.14.0-17.el9.x86_64.rpm 2.3 MB/s | 1.0 MB 00:00 2026-02-13T21:15:13.484 INFO:teuthology.orchestra.run.trial090.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 2.1 MB/s | 177 kB 00:00 2026-02-13T21:15:13.498 INFO:teuthology.orchestra.run.trial090.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 420 kB/s | 35 kB 00:00 2026-02-13T21:15:13.604 INFO:teuthology.orchestra.run.trial090.stdout:(44/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 4.1 MB/s | 442 kB 00:00 2026-02-13T21:15:13.674 INFO:teuthology.orchestra.run.trial090.stdout:(45/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 4.7 MB/s | 1.2 MB 00:00 2026-02-13T21:15:13.681 INFO:teuthology.orchestra.run.trial090.stdout:(46/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 31 MB/s | 6.1 MB 00:00 2026-02-13T21:15:13.689 INFO:teuthology.orchestra.run.trial090.stdout:(47/95): python3-packaging-20.9-5.el9.noarch.rp 909 kB/s | 77 kB 00:00 2026-02-13T21:15:13.766 INFO:teuthology.orchestra.run.trial090.stdout:(48/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2026-02-13T21:15:13.767 INFO:teuthology.orchestra.run.trial090.stdout:(49/95): python3-protobuf-3.14.0-17.el9.noarch. 2.8 MB/s | 267 kB 00:00 2026-02-13T21:15:13.785 INFO:teuthology.orchestra.run.trial090.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 2.8 MB/s | 279 kB 00:00 2026-02-13T21:15:13.850 INFO:teuthology.orchestra.run.trial090.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 642 kB/s | 54 kB 00:00 2026-02-13T21:15:13.868 INFO:teuthology.orchestra.run.trial090.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 500 kB/s | 42 kB 00:00 2026-02-13T21:15:13.939 INFO:teuthology.orchestra.run.trial090.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.1 MB/s | 189 kB 00:00 2026-02-13T21:15:13.954 INFO:teuthology.orchestra.run.trial090.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.0 MB/s | 90 kB 00:00 2026-02-13T21:15:13.962 INFO:teuthology.orchestra.run.trial090.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 967 kB/s | 22 kB 00:00 2026-02-13T21:15:14.011 INFO:teuthology.orchestra.run.trial090.stdout:(56/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 11 MB/s | 551 kB 00:00 2026-02-13T21:15:14.017 INFO:teuthology.orchestra.run.trial090.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 3.3 MB/s | 19 kB 00:00 2026-02-13T21:15:14.019 INFO:teuthology.orchestra.run.trial090.stdout:(58/95): protobuf-compiler-3.14.0-17.el9.x86_64 13 MB/s | 862 kB 00:00 2026-02-13T21:15:14.028 INFO:teuthology.orchestra.run.trial090.stdout:(59/95): python3-asyncssh-2.13.2-5.el9.noarch.r 57 MB/s | 548 kB 00:00 2026-02-13T21:15:14.034 INFO:teuthology.orchestra.run.trial090.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 5.0 MB/s | 29 kB 00:00 2026-02-13T21:15:14.040 INFO:teuthology.orchestra.run.trial090.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 9.7 MB/s | 60 kB 00:00 2026-02-13T21:15:14.047 INFO:teuthology.orchestra.run.trial090.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 6.9 MB/s | 43 kB 00:00 2026-02-13T21:15:14.052 INFO:teuthology.orchestra.run.trial090.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 6.1 MB/s | 32 kB 00:00 2026-02-13T21:15:14.058 INFO:teuthology.orchestra.run.trial090.stdout:(64/95): python3-certifi-2023.05.07-4.el9.noarc 2.3 MB/s | 14 kB 00:00 2026-02-13T21:15:14.075 INFO:teuthology.orchestra.run.trial090.stdout:(65/95): python3-cheroot-10.0.1-4.el9.noarch.rp 9.8 MB/s | 173 kB 00:00 2026-02-13T21:15:14.084 INFO:teuthology.orchestra.run.trial090.stdout:(66/95): python3-cherrypy-18.6.1-2.el9.noarch.r 43 MB/s | 358 kB 00:00 2026-02-13T21:15:14.092 INFO:teuthology.orchestra.run.trial090.stdout:(67/95): python3-google-auth-2.45.0-1.el9.noarc 32 MB/s | 254 kB 00:00 2026-02-13T21:15:14.107 INFO:teuthology.orchestra.run.trial090.stdout:(68/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 129 MB/s | 2.0 MB 00:00 2026-02-13T21:15:14.108 INFO:teuthology.orchestra.run.trial090.stdout:(69/95): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2026-02-13T21:15:14.114 INFO:teuthology.orchestra.run.trial090.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 20 MB/s | 144 kB 00:00 2026-02-13T21:15:14.132 INFO:teuthology.orchestra.run.trial090.stdout:(71/95): python3-isodate-0.6.1-3.el9.noarch.rpm 3.1 MB/s | 56 kB 00:00 2026-02-13T21:15:14.145 INFO:teuthology.orchestra.run.trial090.stdout:(72/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 863 kB/s | 11 kB 00:00 2026-02-13T21:15:14.151 INFO:teuthology.orchestra.run.trial090.stdout:(73/95): python3-jaraco-classes-3.2.1-5.el9.noa 2.7 MB/s | 18 kB 00:00 2026-02-13T21:15:14.164 INFO:teuthology.orchestra.run.trial090.stdout:(74/95): python3-jaraco-collections-3.0.0-8.el9 1.8 MB/s | 23 kB 00:00 2026-02-13T21:15:14.170 INFO:teuthology.orchestra.run.trial090.stdout:(75/95): python3-jaraco-context-6.0.1-3.el9.noa 3.1 MB/s | 20 kB 00:00 2026-02-13T21:15:14.177 INFO:teuthology.orchestra.run.trial090.stdout:(76/95): python3-jaraco-functools-3.5.0-2.el9.n 3.1 MB/s | 19 kB 00:00 2026-02-13T21:15:14.183 INFO:teuthology.orchestra.run.trial090.stdout:(77/95): python3-jaraco-text-4.0.0-2.el9.noarch 4.2 MB/s | 26 kB 00:00 2026-02-13T21:15:14.207 INFO:teuthology.orchestra.run.trial090.stdout:(78/95): python3-influxdb-5.3.1-1.el9.noarch.rp 1.4 MB/s | 139 kB 00:00 2026-02-13T21:15:14.214 INFO:teuthology.orchestra.run.trial090.stdout:(79/95): python3-kubernetes-26.1.0-3.el9.noarch 33 MB/s | 1.0 MB 00:00 2026-02-13T21:15:14.221 INFO:teuthology.orchestra.run.trial090.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 13 MB/s | 86 kB 00:00 2026-02-13T21:15:14.227 INFO:teuthology.orchestra.run.trial090.stdout:(81/95): python3-natsort-7.1.1-5.el9.noarch.rpm 9.0 MB/s | 58 kB 00:00 2026-02-13T21:15:14.232 INFO:teuthology.orchestra.run.trial090.stdout:(82/95): python3-portend-3.1.0-2.el9.noarch.rpm 3.1 MB/s | 16 kB 00:00 2026-02-13T21:15:14.239 INFO:teuthology.orchestra.run.trial090.stdout:(83/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 14 MB/s | 90 kB 00:00 2026-02-13T21:15:14.244 INFO:teuthology.orchestra.run.trial090.stdout:(84/95): python3-repoze-lru-0.7-16.el9.noarch.r 5.8 MB/s | 31 kB 00:00 2026-02-13T21:15:14.251 INFO:teuthology.orchestra.run.trial090.stdout:(85/95): python3-routes-2.5.1-5.el9.noarch.rpm 28 MB/s | 188 kB 00:00 2026-02-13T21:15:14.258 INFO:teuthology.orchestra.run.trial090.stdout:(86/95): python3-rsa-4.9-2.el9.noarch.rpm 8.3 MB/s | 59 kB 00:00 2026-02-13T21:15:14.264 INFO:teuthology.orchestra.run.trial090.stdout:(87/95): python3-saml-1.16.0-1.el9.noarch.rpm 19 MB/s | 125 kB 00:00 2026-02-13T21:15:14.268 INFO:teuthology.orchestra.run.trial090.stdout:(88/95): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2026-02-13T21:15:14.274 INFO:teuthology.orchestra.run.trial090.stdout:(89/95): python3-typing-extensions-4.15.0-1.el9 13 MB/s | 86 kB 00:00 2026-02-13T21:15:14.278 INFO:teuthology.orchestra.run.trial090.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 2.6 MB/s | 36 kB 00:00 2026-02-13T21:15:14.286 INFO:teuthology.orchestra.run.trial090.stdout:(91/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 6.0 MB/s | 48 kB 00:00 2026-02-13T21:15:14.288 INFO:teuthology.orchestra.run.trial090.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 6.3 MB/s | 90 kB 00:00 2026-02-13T21:15:14.292 INFO:teuthology.orchestra.run.trial090.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 3.8 MB/s | 22 kB 00:00 2026-02-13T21:15:14.314 INFO:teuthology.orchestra.run.trial090.stdout:(94/95): python3-zc-lockfile-2.0-10.el9.noarch. 772 kB/s | 20 kB 00:00 2026-02-13T21:15:14.418 INFO:teuthology.orchestra.run.trial090.stdout:(95/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 30 MB/s | 19 MB 00:00 2026-02-13T21:15:14.419 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:14.419 INFO:teuthology.orchestra.run.trial090.stdout:Total 8.2 MB/s | 101 MB 00:12 2026-02-13T21:15:14.837 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:15:14.875 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:15:14.875 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:15:15.308 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:15:15.308 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:15:15.780 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:15:15.782 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-13T21:15:15.786 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-13T21:15:15.807 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-13T21:15:15.842 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-13T21:15:15.852 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-13T21:15:15.857 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-13T21:15:15.859 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-13T21:15:15.864 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 8/95 2026-02-13T21:15:15.887 INFO:teuthology.orchestra.run.trial090.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-13T21:15:15.899 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-13T21:15:15.902 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-13T21:15:15.908 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-13T21:15:15.910 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-13T21:15:15.921 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-13T21:15:15.927 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-13T21:15:15.951 INFO:teuthology.orchestra.run.trial090.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-13T21:15:15.955 INFO:teuthology.orchestra.run.trial090.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-13T21:15:15.962 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-13T21:15:16.012 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-13T21:15:16.025 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-13T21:15:16.027 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-13T21:15:16.032 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-13T21:15:16.037 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-13T21:15:16.042 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-13T21:15:16.045 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-13T21:15:16.060 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-13T21:15:16.064 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-13T21:15:16.069 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-13T21:15:16.080 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-13T21:15:16.089 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-13T21:15:16.096 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-13T21:15:16.115 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-13T21:15:16.126 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-13T21:15:16.142 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-13T21:15:16.146 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-13T21:15:16.154 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-13T21:15:16.193 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-13T21:15:16.267 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] cryptsetup-2.8.1-2.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/cryptsetup-2.8.1-2.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:16.267 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] ledmon-libs-1.1.0-3.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/ledmon-libs-1.1.0-3.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:16.267 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] libconfig-1.7.2-9.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libconfig-1.7.2-9.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:16.519 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-13T21:15:16.528 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-13T21:15:16.532 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-13T21:15:16.538 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-13T21:15:16.540 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-13T21:15:16.559 INFO:teuthology.orchestra.run.trial012.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 6.0 kB/s | 40 kB 00:06 2026-02-13T21:15:16.568 INFO:teuthology.orchestra.run.trial090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-13T21:15:16.612 INFO:teuthology.orchestra.run.trial090.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-13T21:15:16.619 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-13T21:15:16.622 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-13T21:15:16.628 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-13T21:15:16.632 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-13T21:15:16.639 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-13T21:15:16.641 INFO:teuthology.orchestra.run.trial012.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 11 kB/s | 72 kB 00:06 2026-02-13T21:15:16.642 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-13T21:15:16.670 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-13T21:15:16.680 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-13T21:15:16.687 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-13T21:15:16.694 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-13T21:15:16.729 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-13T21:15:16.825 INFO:teuthology.orchestra.run.trial012.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 50 kB/s | 350 kB 00:07 2026-02-13T21:15:16.953 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-13T21:15:16.977 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-13T21:15:16.980 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-13T21:15:17.039 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-13T21:15:17.041 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-13T21:15:17.062 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/95 2026-02-13T21:15:17.387 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 62/95 2026-02-13T21:15:17.460 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-13T21:15:18.133 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-13T21:15:18.150 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-13T21:15:18.160 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-13T21:15:18.167 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-13T21:15:18.180 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-13T21:15:18.196 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-13T21:15:18.272 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-13T21:15:18.280 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-13T21:15:18.304 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-13T21:15:18.333 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-13T21:15:18.384 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-13T21:15:18.390 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-13T21:15:18.393 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-13T21:15:18.394 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-13T21:15:18.413 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T21:15:18.413 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T21:15:18.413 INFO:teuthology.orchestra.run.trial090.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T21:15:18.413 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:18.422 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T21:15:18.448 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T21:15:18.448 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T21:15:18.448 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:18.486 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-13T21:15:18.548 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-13T21:15:18.551 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch 81/95 2026-02-13T21:15:18.565 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch 81/95 2026-02-13T21:15:18.565 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:18.565 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T21:15:18.565 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:19.027 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] libgfortran-11.5.0-14.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-14.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:19.027 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] libquadmath-11.5.0-14.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-14.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:19.027 INFO:teuthology.orchestra.run.trial012.stdout:[MIRROR] python3-cffi-1.14.5-5.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-cffi-1.14.5-5.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T21:15:19.254 INFO:teuthology.orchestra.run.trial012.stdout:(19/95): libgfortran-11.5.0-14.el9.x86_64.rpm 295 kB/s | 794 kB 00:02 2026-02-13T21:15:19.276 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-2:20.2.0-690.g3baf6bae.el9.x86_64 82/95 2026-02-13T21:15:19.293 INFO:teuthology.orchestra.run.trial012.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 103 kB/s | 253 kB 00:02 2026-02-13T21:15:19.301 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-2:20.2.0-690.g3baf6bae.el9.x86_64 82/95 2026-02-13T21:15:19.301 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:19.301 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T21:15:19.301 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T21:15:19.302 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T21:15:19.302 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:19.317 INFO:teuthology.orchestra.run.trial012.stdout:(21/95): libquadmath-11.5.0-14.el9.x86_64.rpm 69 kB/s | 184 kB 00:02 2026-02-13T21:15:19.367 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 83/95 2026-02-13T21:15:19.369 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 83/95 2026-02-13T21:15:19.376 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-690.g3baf6bae.el9. 84/95 2026-02-13T21:15:19.396 INFO:teuthology.orchestra.run.trial012.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2026-02-13T21:15:19.399 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-690.g3baf6bae.el9 85/95 2026-02-13T21:15:19.400 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 86/95 2026-02-13T21:15:19.432 INFO:teuthology.orchestra.run.trial012.stdout:(23/95): python3-cryptography-36.0.1-5.el9.x86_ 7.0 MB/s | 1.2 MB 00:00 2026-02-13T21:15:19.435 INFO:teuthology.orchestra.run.trial012.stdout:(24/95): python3-pycparser-2.20-6.el9.noarch.rp 1.1 MB/s | 135 kB 00:00 2026-02-13T21:15:19.509 INFO:teuthology.orchestra.run.trial012.stdout:(25/95): python3-pyparsing-2.4.7-9.el9.noarch.r 1.3 MB/s | 150 kB 00:00 2026-02-13T21:15:19.516 INFO:teuthology.orchestra.run.trial012.stdout:(26/95): python3-requests-2.25.1-10.el9.noarch. 1.5 MB/s | 126 kB 00:00 2026-02-13T21:15:19.577 INFO:teuthology.orchestra.run.trial012.stdout:(27/95): python3-urllib3-1.26.5-7.el9.noarch.rp 1.5 MB/s | 218 kB 00:00 2026-02-13T21:15:19.603 INFO:teuthology.orchestra.run.trial012.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 3.0 MB/s | 266 kB 00:00 2026-02-13T21:15:19.627 INFO:teuthology.orchestra.run.trial012.stdout:(29/95): unzip-6.0-59.el9.x86_64.rpm 1.5 MB/s | 182 kB 00:00 2026-02-13T21:15:19.990 INFO:teuthology.orchestra.run.trial012.stdout:(30/95): flexiblas-3.0.4-8.el9.x86_64.rpm 79 kB/s | 33 kB 00:00 2026-02-13T21:15:20.030 INFO:teuthology.orchestra.run.trial012.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-8.el9. 45 kB/s | 18 kB 00:00 2026-02-13T21:15:20.271 INFO:teuthology.orchestra.run.trial012.stdout:(32/95): lua-5.4.4-4.el9.x86_64.rpm 782 kB/s | 188 kB 00:00 2026-02-13T21:15:20.309 INFO:teuthology.orchestra.run.trial012.stdout:(33/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 771 kB/s | 246 kB 00:00 2026-02-13T21:15:20.354 INFO:teuthology.orchestra.run.trial012.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 507 kB/s | 42 kB 00:00 2026-02-13T21:15:20.571 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 86/95 2026-02-13T21:15:20.577 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noar 87/95 2026-02-13T21:15:21.044 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noar 87/95 2026-02-13T21:15:21.045 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6b 88/95 2026-02-13T21:15:21.058 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6b 88/95 2026-02-13T21:15:21.058 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-690.g3baf6bae.el9.noar 89/95 2026-02-13T21:15:21.118 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-690.g3baf6bae.el9.noar 89/95 2026-02-13T21:15:21.146 INFO:teuthology.orchestra.run.trial012.stdout:(35/95): protobuf-3.14.0-17.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2026-02-13T21:15:21.162 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-690.g3baf6bae.el9.n 90/95 2026-02-13T21:15:21.163 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 91/95 2026-02-13T21:15:21.185 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 91/95 2026-02-13T21:15:21.185 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:21.186 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T21:15:21.186 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T21:15:21.186 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T21:15:21.186 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:21.197 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch 92/95 2026-02-13T21:15:21.438 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch 92/95 2026-02-13T21:15:21.439 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mon-2:20.2.0-690.g3baf6bae.el9.x86_64 93/95 2026-02-13T21:15:21.461 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mon-2:20.2.0-690.g3baf6bae.el9.x86_64 93/95 2026-02-13T21:15:21.461 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:21.461 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T21:15:21.461 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T21:15:21.461 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T21:15:21.461 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:21.563 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mds-2:20.2.0-690.g3baf6bae.el9.x86_64 94/95 2026-02-13T21:15:21.584 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mds-2:20.2.0-690.g3baf6bae.el9.x86_64 94/95 2026-02-13T21:15:21.584 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:21.584 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T21:15:21.585 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T21:15:21.585 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T21:15:21.585 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:21.602 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-2:20.2.0-690.g3baf6bae.el9.x86_64 95/95 2026-02-13T21:15:22.278 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-2:20.2.0-690.g3baf6bae.el9.x86_64 95/95 2026-02-13T21:15:22.278 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-2:20.2.0-690.g3baf6bae.el9.x86_64 1/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mds-2:20.2.0-690.g3baf6bae.el9.x86_64 2/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 3/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mon-2:20.2.0-690.g3baf6bae.el9.x86_64 4/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-osd-2:20.2.0-690.g3baf6bae.el9.x86_64 5/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-690.g3baf6bae.el9 6/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 7/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noar 8/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6b 9/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-690.g3baf6bae.el9.noar 10/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-690.g3baf6bae.el9.n 11/95 2026-02-13T21:15:22.279 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch 12/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-690.g3baf6bae.el9. 13/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch 14/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 15/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-13T21:15:22.280 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 30/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 31/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 32/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-13T21:15:22.281 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-13T21:15:22.282 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-13T21:15:22.283 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-13T21:15:22.284 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-13T21:15:22.285 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-13T21:15:22.286 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-13T21:15:22.286 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-13T21:15:22.286 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-13T21:15:22.286 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-13T21:15:22.286 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-13T21:15:22.286 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-13T21:15:22.340 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-13T21:15:22.340 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:22.340 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:22.340 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T21:15:22.340 INFO:teuthology.orchestra.run.trial090.stdout: ceph-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:22.340 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.340 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:22.340 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T21:15:22.341 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T21:15:22.342 INFO:teuthology.orchestra.run.trial090.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T21:15:22.343 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T21:15:22.344 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-13T21:15:22.345 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-13T21:15:22.346 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-13T21:15:22.347 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T21:15:22.348 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T21:15:22.348 INFO:teuthology.orchestra.run.trial090.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T21:15:22.348 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-13T21:15:22.348 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-13T21:15:22.348 INFO:teuthology.orchestra.run.trial090.stdout: zip-3.0-35.el9.x86_64 2026-02-13T21:15:22.348 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:22.348 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:22.393 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-base 2026-02-13T21:15:22.693 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:42 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:22.760 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:22.778 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:22.779 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:22.779 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:22.800 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install cephadm 2026-02-13T21:15:23.105 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:43 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:23.172 INFO:teuthology.orchestra.run.trial090.stdout:Package cephadm-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:23.190 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:23.191 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:23.191 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:23.213 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-immutable-object-cache 2026-02-13T21:15:23.516 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:43 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:23.598 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:23.599 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:23.599 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-13T21:15:23.599 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 154 k 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 154 k 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 447 k 2026-02-13T21:15:23.600 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:15:23.693 INFO:teuthology.orchestra.run.trial090.stdout:ceph-immutable-object-cache-20.2.0-690.g3baf6ba 1.6 MB/s | 154 kB 00:00 2026-02-13T21:15:23.693 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:23.693 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.6 MB/s | 154 kB 00:00 2026-02-13T21:15:23.693 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:15:23.697 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:15:23.698 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:15:23.729 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:15:23.730 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:15:23.786 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:15:23.787 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-690.g3baf6bae.e 1/1 2026-02-13T21:15:23.809 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-690.g3baf6bae.e 1/1 2026-02-13T21:15:23.809 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:23.809 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T21:15:23.809 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:23.929 INFO:teuthology.orchestra.run.trial012.stdout:(36/95): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 708 kB/s | 3.0 MB 00:04 2026-02-13T21:15:24.083 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-690.g3baf6bae.e 1/1 2026-02-13T21:15:24.084 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:24.084 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:24.084 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:24.084 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:24.084 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:24.092 INFO:teuthology.orchestra.run.trial012.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2026-02-13T21:15:24.109 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr 2026-02-13T21:15:24.255 INFO:teuthology.orchestra.run.trial012.stdout:(38/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-13T21:15:24.338 INFO:teuthology.orchestra.run.trial012.stdout:(39/95): python3-jmespath-1.0.1-1.el9.noarch.rp 571 kB/s | 48 kB 00:00 2026-02-13T21:15:24.411 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:44 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:24.478 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:24.496 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:24.497 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:24.497 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:24.500 INFO:teuthology.orchestra.run.trial012.stdout:(40/95): python3-libstoragemgmt-1.10.1-1.el9.x8 1.1 MB/s | 177 kB 00:00 2026-02-13T21:15:24.519 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-dashboard 2026-02-13T21:15:24.821 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:44 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:24.886 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:24.905 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:24.905 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:24.905 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:24.928 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-13T21:15:25.200 INFO:teuthology.orchestra.run.trial012.stdout:(41/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 1.1 MB/s | 5.3 MB 00:04 2026-02-13T21:15:25.226 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:45 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:25.284 INFO:teuthology.orchestra.run.trial012.stdout:(42/95): python3-markupsafe-1.1.1-12.el9.x86_64 415 kB/s | 35 kB 00:00 2026-02-13T21:15:25.292 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:25.294 INFO:teuthology.orchestra.run.trial012.stdout:(43/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.5 MB/s | 1.2 MB 00:00 2026-02-13T21:15:25.310 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:25.311 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:25.311 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:25.332 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-rook 2026-02-13T21:15:25.615 INFO:teuthology.orchestra.run.trial012.stdout:(44/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 1.4 MB/s | 442 kB 00:00 2026-02-13T21:15:25.632 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:45 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:25.698 INFO:teuthology.orchestra.run.trial012.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 922 kB/s | 77 kB 00:00 2026-02-13T21:15:25.699 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:25.719 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:25.719 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:25.719 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:25.741 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-cephadm 2026-02-13T21:15:25.802 INFO:teuthology.orchestra.run.trial012.stdout:(46/95): python3-babel-2.9.1-2.el9.noarch.rpm 1.3 MB/s | 6.0 MB 00:04 2026-02-13T21:15:25.861 INFO:teuthology.orchestra.run.trial012.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 1.6 MB/s | 267 kB 00:00 2026-02-13T21:15:25.965 INFO:teuthology.orchestra.run.trial012.stdout:(48/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 975 kB/s | 159 kB 00:00 2026-02-13T21:15:26.041 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:46 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:26.050 INFO:teuthology.orchestra.run.trial012.stdout:(49/95): python3-requests-oauthlib-1.3.0-12.el9 642 kB/s | 54 kB 00:00 2026-02-13T21:15:26.102 INFO:teuthology.orchestra.run.trial012.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2026-02-13T21:15:26.106 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:26.124 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:26.125 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:26.125 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:26.147 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-fuse 2026-02-13T21:15:26.186 INFO:teuthology.orchestra.run.trial012.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 500 kB/s | 42 kB 00:00 2026-02-13T21:15:26.347 INFO:teuthology.orchestra.run.trial012.stdout:(52/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.1 MB/s | 189 kB 00:00 2026-02-13T21:15:26.431 INFO:teuthology.orchestra.run.trial012.stdout:(53/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-13T21:15:26.447 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:46 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:26.460 INFO:teuthology.orchestra.run.trial012.stdout:(54/95): lua-devel-5.4.4-4.el9.x86_64.rpm 770 kB/s | 22 kB 00:00 2026-02-13T21:15:26.501 INFO:teuthology.orchestra.run.trial012.stdout:(55/95): protobuf-compiler-3.14.0-17.el9.x86_64 21 MB/s | 862 kB 00:00 2026-02-13T21:15:26.532 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:26.532 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:26.532 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-13T21:15:26.532 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 939 k 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 939 k 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 2.7 M 2026-02-13T21:15:26.533 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:15:26.645 INFO:teuthology.orchestra.run.trial012.stdout:(56/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.7 MB/s | 551 kB 00:00 2026-02-13T21:15:26.652 INFO:teuthology.orchestra.run.trial090.stdout:ceph-fuse-20.2.0-690.g3baf6bae.el9.x86_64.rpm 7.7 MB/s | 939 kB 00:00 2026-02-13T21:15:26.652 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:26.652 INFO:teuthology.orchestra.run.trial090.stdout:Total 7.6 MB/s | 939 kB 00:00 2026-02-13T21:15:26.653 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:15:26.657 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:15:26.657 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:15:26.665 INFO:teuthology.orchestra.run.trial012.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 954 kB/s | 19 kB 00:00 2026-02-13T21:15:26.687 INFO:teuthology.orchestra.run.trial012.stdout:(58/95): luarocks-3.9.2-5.el9.noarch.rpm 6.8 MB/s | 151 kB 00:00 2026-02-13T21:15:26.692 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:15:26.692 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:15:26.712 INFO:teuthology.orchestra.run.trial012.stdout:(59/95): python3-asyncssh-2.13.2-5.el9.noarch.r 22 MB/s | 548 kB 00:00 2026-02-13T21:15:26.733 INFO:teuthology.orchestra.run.trial012.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 1.4 MB/s | 29 kB 00:00 2026-02-13T21:15:26.754 INFO:teuthology.orchestra.run.trial012.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 2.8 MB/s | 60 kB 00:00 2026-02-13T21:15:26.775 INFO:teuthology.orchestra.run.trial012.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.0 MB/s | 43 kB 00:00 2026-02-13T21:15:26.782 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:15:26.796 INFO:teuthology.orchestra.run.trial012.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 1.5 MB/s | 32 kB 00:00 2026-02-13T21:15:26.798 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:26.817 INFO:teuthology.orchestra.run.trial012.stdout:(64/95): python3-certifi-2023.05.07-4.el9.noarc 684 kB/s | 14 kB 00:00 2026-02-13T21:15:26.840 INFO:teuthology.orchestra.run.trial012.stdout:(65/95): python3-cheroot-10.0.1-4.el9.noarch.rp 7.4 MB/s | 173 kB 00:00 2026-02-13T21:15:26.868 INFO:teuthology.orchestra.run.trial012.stdout:(66/95): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2026-02-13T21:15:26.891 INFO:teuthology.orchestra.run.trial012.stdout:(67/95): python3-google-auth-2.45.0-1.el9.noarc 11 MB/s | 254 kB 00:00 2026-02-13T21:15:26.969 INFO:teuthology.orchestra.run.trial012.stdout:(68/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 26 MB/s | 2.0 MB 00:00 2026-02-13T21:15:26.992 INFO:teuthology.orchestra.run.trial012.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 6.2 MB/s | 144 kB 00:00 2026-02-13T21:15:27.015 INFO:teuthology.orchestra.run.trial012.stdout:(70/95): python3-influxdb-5.3.1-1.el9.noarch.rp 5.9 MB/s | 139 kB 00:00 2026-02-13T21:15:27.036 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:27.036 INFO:teuthology.orchestra.run.trial012.stdout:(71/95): python3-isodate-0.6.1-3.el9.noarch.rpm 2.6 MB/s | 56 kB 00:00 2026-02-13T21:15:27.057 INFO:teuthology.orchestra.run.trial012.stdout:(72/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 518 kB/s | 11 kB 00:00 2026-02-13T21:15:27.078 INFO:teuthology.orchestra.run.trial012.stdout:(73/95): python3-jaraco-classes-3.2.1-5.el9.noa 851 kB/s | 18 kB 00:00 2026-02-13T21:15:27.091 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:27.091 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:27.091 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:27.091 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:27.091 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:27.091 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:27.099 INFO:teuthology.orchestra.run.trial012.stdout:(74/95): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-13T21:15:27.119 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-volume 2026-02-13T21:15:27.120 INFO:teuthology.orchestra.run.trial012.stdout:(75/95): python3-jaraco-context-6.0.1-3.el9.noa 935 kB/s | 20 kB 00:00 2026-02-13T21:15:27.142 INFO:teuthology.orchestra.run.trial012.stdout:(76/95): python3-jaraco-functools-3.5.0-2.el9.n 928 kB/s | 19 kB 00:00 2026-02-13T21:15:27.163 INFO:teuthology.orchestra.run.trial012.stdout:(77/95): python3-jaraco-text-4.0.0-2.el9.noarch 1.2 MB/s | 26 kB 00:00 2026-02-13T21:15:27.189 INFO:teuthology.orchestra.run.trial012.stdout:(78/95): python3-kubernetes-26.1.0-3.el9.noarch 40 MB/s | 1.0 MB 00:00 2026-02-13T21:15:27.210 INFO:teuthology.orchestra.run.trial012.stdout:(79/95): python3-more-itertools-8.12.0-2.el9.no 3.6 MB/s | 79 kB 00:00 2026-02-13T21:15:27.232 INFO:teuthology.orchestra.run.trial012.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.9 MB/s | 86 kB 00:00 2026-02-13T21:15:27.253 INFO:teuthology.orchestra.run.trial012.stdout:(81/95): python3-natsort-7.1.1-5.el9.noarch.rpm 2.6 MB/s | 58 kB 00:00 2026-02-13T21:15:27.274 INFO:teuthology.orchestra.run.trial012.stdout:(82/95): python3-portend-3.1.0-2.el9.noarch.rpm 792 kB/s | 16 kB 00:00 2026-02-13T21:15:27.296 INFO:teuthology.orchestra.run.trial012.stdout:(83/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.1 MB/s | 90 kB 00:00 2026-02-13T21:15:27.317 INFO:teuthology.orchestra.run.trial012.stdout:(84/95): python3-repoze-lru-0.7-16.el9.noarch.r 1.4 MB/s | 31 kB 00:00 2026-02-13T21:15:27.340 INFO:teuthology.orchestra.run.trial012.stdout:(85/95): python3-routes-2.5.1-5.el9.noarch.rpm 8.2 MB/s | 188 kB 00:00 2026-02-13T21:15:27.361 INFO:teuthology.orchestra.run.trial012.stdout:(86/95): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2026-02-13T21:15:27.383 INFO:teuthology.orchestra.run.trial012.stdout:(87/95): python3-saml-1.16.0-1.el9.noarch.rpm 5.6 MB/s | 125 kB 00:00 2026-02-13T21:15:27.404 INFO:teuthology.orchestra.run.trial012.stdout:(88/95): python3-tempora-5.0.0-2.el9.noarch.rpm 1.7 MB/s | 36 kB 00:00 2026-02-13T21:15:27.419 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:27.426 INFO:teuthology.orchestra.run.trial012.stdout:(89/95): python3-typing-extensions-4.15.0-1.el9 3.9 MB/s | 86 kB 00:00 2026-02-13T21:15:27.447 INFO:teuthology.orchestra.run.trial012.stdout:(90/95): python3-websocket-client-1.2.3-2.el9.n 4.1 MB/s | 90 kB 00:00 2026-02-13T21:15:27.469 INFO:teuthology.orchestra.run.trial012.stdout:(91/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.2 MB/s | 48 kB 00:00 2026-02-13T21:15:27.484 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:27.490 INFO:teuthology.orchestra.run.trial012.stdout:(92/95): python3-xmltodict-0.12.0-15.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-13T21:15:27.503 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:27.504 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:27.504 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:27.511 INFO:teuthology.orchestra.run.trial012.stdout:(93/95): python3-zc-lockfile-2.0-10.el9.noarch. 960 kB/s | 20 kB 00:00 2026-02-13T21:15:27.527 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librados-devel 2026-02-13T21:15:27.831 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:27.916 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:27.916 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 126 k 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:27.917 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 126 k 2026-02-13T21:15:27.918 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 449 k 2026-02-13T21:15:27.918 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:15:28.007 INFO:teuthology.orchestra.run.trial090.stdout:librados-devel-20.2.0-690.g3baf6bae.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-13T21:15:28.007 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:28.008 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-13T21:15:28.008 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:15:28.010 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:15:28.010 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:15:28.041 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:15:28.042 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:15:28.096 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:15:28.112 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librados-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:28.193 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:28.251 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:28.252 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:28.252 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:28.252 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:28.252 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:28.252 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:28.280 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install libcephfs2 2026-02-13T21:15:28.592 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:28.660 INFO:teuthology.orchestra.run.trial090.stdout:Package libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:28.679 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:28.680 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:28.680 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:28.702 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install libcephfs-devel 2026-02-13T21:15:29.006 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:29.089 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 34 k 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-13T21:15:29.090 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:29.091 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 34 k 2026-02-13T21:15:29.091 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 155 k 2026-02-13T21:15:29.091 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:15:29.152 INFO:teuthology.orchestra.run.trial090.stdout:libcephfs-devel-20.2.0-690.g3baf6bae.el9.x86_64 555 kB/s | 34 kB 00:00 2026-02-13T21:15:29.152 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:29.153 INFO:teuthology.orchestra.run.trial090.stdout:Total 547 kB/s | 34 kB 00:00 2026-02-13T21:15:29.153 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:15:29.155 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:15:29.155 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:15:29.157 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:15:29.157 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:15:29.178 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:15:29.194 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:29.248 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:29.305 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:29.305 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:29.305 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:29.305 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:29.305 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:29.305 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:29.334 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librados2 2026-02-13T21:15:29.634 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:29.699 INFO:teuthology.orchestra.run.trial090.stdout:Package librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:29.717 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:29.718 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:29.718 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:29.740 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librbd1 2026-02-13T21:15:30.034 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:30.099 INFO:teuthology.orchestra.run.trial090.stdout:Package librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:30.118 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:30.118 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:30.118 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:30.140 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rados 2026-02-13T21:15:30.440 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:30.507 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rados-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:30.525 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:30.526 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:30.526 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:30.548 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rgw 2026-02-13T21:15:30.809 INFO:teuthology.orchestra.run.trial012.stdout:(94/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 1.1 MB/s | 6.1 MB 00:05 2026-02-13T21:15:30.856 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:30.922 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rgw-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:30.940 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:30.941 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:30.941 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:30.963 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-cephfs 2026-02-13T21:15:31.261 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:31.326 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-cephfs-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:31.345 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:31.345 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:31.346 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:31.367 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rbd 2026-02-13T21:15:31.669 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:31.735 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rbd-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:31.754 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:31.754 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-13T21:15:31.754 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:31.778 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-fuse 2026-02-13T21:15:32.080 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:32.165 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:32.165 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:32.165 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 91 k 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 91 k 2026-02-13T21:15:32.166 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 238 k 2026-02-13T21:15:32.167 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:15:32.240 INFO:teuthology.orchestra.run.trial090.stdout:rbd-fuse-20.2.0-690.g3baf6bae.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-13T21:15:32.240 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:32.240 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-13T21:15:32.240 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:15:32.245 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:15:32.245 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:15:32.277 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:15:32.277 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:15:32.328 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:15:32.345 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:32.419 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:32.475 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:32.475 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:32.475 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:32.475 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:32.475 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:32.476 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:32.505 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-mirror 2026-02-13T21:15:32.810 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:32.894 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:32.894 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:32.894 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-13T21:15:32.894 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 2.9 M 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 2.9 M 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 11 M 2026-02-13T21:15:32.895 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:15:33.038 INFO:teuthology.orchestra.run.trial090.stdout:rbd-mirror-20.2.0-690.g3baf6bae.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-13T21:15:33.039 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:33.039 INFO:teuthology.orchestra.run.trial090.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-13T21:15:33.039 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:15:33.044 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:15:33.044 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:15:33.086 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:15:33.087 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:15:33.270 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:15:33.271 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-mirror-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:33.295 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-mirror-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:33.295 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:33.295 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T21:15:33.296 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T21:15:33.296 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T21:15:33.296 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:33.585 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-mirror-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:33.585 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:33.585 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:33.586 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:33.586 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:33.586 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:33.613 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-nbd 2026-02-13T21:15:33.917 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:15:34.000 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:15:34.001 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:34.001 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 180 k 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 180 k 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 498 k 2026-02-13T21:15:34.002 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:15:34.086 INFO:teuthology.orchestra.run.trial090.stdout:rbd-nbd-20.2.0-690.g3baf6bae.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-13T21:15:34.087 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:34.087 INFO:teuthology.orchestra.run.trial090.stdout:Total 2.0 MB/s | 180 kB 00:00 2026-02-13T21:15:34.087 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:15:34.092 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:15:34.092 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:15:34.124 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:15:34.125 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:15:34.180 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:15:34.197 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-nbd-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:34.276 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-nbd-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:34.333 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-nbd-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:34.334 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:34.334 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:15:34.334 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:34.334 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:15:34.334 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:15:34.365 DEBUG:teuthology.parallel:result is None 2026-02-13T21:15:43.382 INFO:teuthology.orchestra.run.trial012.stdout:(95/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 1.1 MB/s | 19 MB 00:17 2026-02-13T21:15:43.384 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:43.384 INFO:teuthology.orchestra.run.trial012.stdout:Total 2.9 MB/s | 101 MB 00:34 2026-02-13T21:15:43.796 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:15:43.833 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:15:43.833 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:15:44.269 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:15:44.269 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:15:44.752 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:15:44.754 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-13T21:15:44.757 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-13T21:15:44.779 INFO:teuthology.orchestra.run.trial012.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-13T21:15:44.812 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-13T21:15:44.822 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-13T21:15:44.827 INFO:teuthology.orchestra.run.trial012.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-13T21:15:44.830 INFO:teuthology.orchestra.run.trial012.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-13T21:15:44.834 INFO:teuthology.orchestra.run.trial012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 8/95 2026-02-13T21:15:44.857 INFO:teuthology.orchestra.run.trial012.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-13T21:15:44.870 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-13T21:15:44.873 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-13T21:15:44.879 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-13T21:15:44.881 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-13T21:15:44.892 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-13T21:15:44.898 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-13T21:15:44.922 INFO:teuthology.orchestra.run.trial012.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-13T21:15:44.926 INFO:teuthology.orchestra.run.trial012.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-13T21:15:44.933 INFO:teuthology.orchestra.run.trial012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-13T21:15:44.983 INFO:teuthology.orchestra.run.trial012.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-13T21:15:44.996 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-13T21:15:44.998 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-13T21:15:45.003 INFO:teuthology.orchestra.run.trial012.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-13T21:15:45.008 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-13T21:15:45.013 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-13T21:15:45.016 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-13T21:15:45.030 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-13T21:15:45.035 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-13T21:15:45.040 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-13T21:15:45.051 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-13T21:15:45.060 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-13T21:15:45.066 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-13T21:15:45.086 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-13T21:15:45.097 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-13T21:15:45.112 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-13T21:15:45.117 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-13T21:15:45.125 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-13T21:15:45.165 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-13T21:15:45.489 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-13T21:15:45.498 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-13T21:15:45.502 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-13T21:15:45.508 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-13T21:15:45.510 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-13T21:15:45.538 INFO:teuthology.orchestra.run.trial012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-13T21:15:45.581 INFO:teuthology.orchestra.run.trial012.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-13T21:15:45.588 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-13T21:15:45.591 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-13T21:15:45.597 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-13T21:15:45.601 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-13T21:15:45.608 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-13T21:15:45.611 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-13T21:15:45.639 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-13T21:15:45.649 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-13T21:15:45.655 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-13T21:15:45.662 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-13T21:15:45.696 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-13T21:15:45.919 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-13T21:15:45.943 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-13T21:15:45.947 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-13T21:15:46.005 INFO:teuthology.orchestra.run.trial012.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-13T21:15:46.007 INFO:teuthology.orchestra.run.trial012.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-13T21:15:46.028 INFO:teuthology.orchestra.run.trial012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/95 2026-02-13T21:15:46.365 INFO:teuthology.orchestra.run.trial012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 62/95 2026-02-13T21:15:46.438 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-13T21:15:47.105 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-13T21:15:47.122 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-13T21:15:47.132 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-13T21:15:47.139 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-13T21:15:47.152 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-13T21:15:47.167 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-13T21:15:47.242 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-13T21:15:47.251 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-13T21:15:47.275 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-13T21:15:47.304 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-13T21:15:47.355 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-13T21:15:47.361 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-13T21:15:47.364 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-13T21:15:47.365 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-13T21:15:47.383 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T21:15:47.384 INFO:teuthology.orchestra.run.trial012.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T21:15:47.384 INFO:teuthology.orchestra.run.trial012.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T21:15:47.384 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:47.392 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T21:15:47.418 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T21:15:47.418 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T21:15:47.418 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:47.453 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-13T21:15:47.515 INFO:teuthology.orchestra.run.trial012.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-13T21:15:47.517 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch 81/95 2026-02-13T21:15:47.530 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch 81/95 2026-02-13T21:15:47.531 INFO:teuthology.orchestra.run.trial012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:47.531 INFO:teuthology.orchestra.run.trial012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T21:15:47.531 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:48.207 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-osd-2:20.2.0-690.g3baf6bae.el9.x86_64 82/95 2026-02-13T21:15:48.232 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-osd-2:20.2.0-690.g3baf6bae.el9.x86_64 82/95 2026-02-13T21:15:48.232 INFO:teuthology.orchestra.run.trial012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:48.232 INFO:teuthology.orchestra.run.trial012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T21:15:48.232 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T21:15:48.232 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T21:15:48.232 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:48.295 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 83/95 2026-02-13T21:15:48.297 INFO:teuthology.orchestra.run.trial012.stdout: Installing : cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 83/95 2026-02-13T21:15:48.304 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-690.g3baf6bae.el9. 84/95 2026-02-13T21:15:48.327 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-690.g3baf6bae.el9 85/95 2026-02-13T21:15:48.328 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 86/95 2026-02-13T21:15:49.470 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 86/95 2026-02-13T21:15:49.475 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noar 87/95 2026-02-13T21:15:49.927 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noar 87/95 2026-02-13T21:15:49.927 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6b 88/95 2026-02-13T21:15:49.940 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6b 88/95 2026-02-13T21:15:49.940 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-690.g3baf6bae.el9.noar 89/95 2026-02-13T21:15:49.997 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-690.g3baf6bae.el9.noar 89/95 2026-02-13T21:15:50.040 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-690.g3baf6bae.el9.n 90/95 2026-02-13T21:15:50.041 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 91/95 2026-02-13T21:15:50.062 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 91/95 2026-02-13T21:15:50.062 INFO:teuthology.orchestra.run.trial012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:50.062 INFO:teuthology.orchestra.run.trial012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T21:15:50.062 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T21:15:50.062 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T21:15:50.063 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:50.073 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch 92/95 2026-02-13T21:15:50.298 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch 92/95 2026-02-13T21:15:50.300 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mon-2:20.2.0-690.g3baf6bae.el9.x86_64 93/95 2026-02-13T21:15:50.321 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-mon-2:20.2.0-690.g3baf6bae.el9.x86_64 93/95 2026-02-13T21:15:50.321 INFO:teuthology.orchestra.run.trial012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:50.321 INFO:teuthology.orchestra.run.trial012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T21:15:50.321 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T21:15:50.321 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T21:15:50.321 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:50.417 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-mds-2:20.2.0-690.g3baf6bae.el9.x86_64 94/95 2026-02-13T21:15:50.437 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-mds-2:20.2.0-690.g3baf6bae.el9.x86_64 94/95 2026-02-13T21:15:50.437 INFO:teuthology.orchestra.run.trial012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:50.437 INFO:teuthology.orchestra.run.trial012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T21:15:50.437 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T21:15:50.437 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T21:15:50.438 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:50.456 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-2:20.2.0-690.g3baf6bae.el9.x86_64 95/95 2026-02-13T21:15:51.146 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-2:20.2.0-690.g3baf6bae.el9.x86_64 95/95 2026-02-13T21:15:51.146 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-2:20.2.0-690.g3baf6bae.el9.x86_64 1/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mds-2:20.2.0-690.g3baf6bae.el9.x86_64 2/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 3/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mon-2:20.2.0-690.g3baf6bae.el9.x86_64 4/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-osd-2:20.2.0-690.g3baf6bae.el9.x86_64 5/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-690.g3baf6bae.el9 6/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 7/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noar 8/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6b 9/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-690.g3baf6bae.el9.noar 10/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-690.g3baf6bae.el9.n 11/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch 12/95 2026-02-13T21:15:51.147 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-690.g3baf6bae.el9. 13/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch 14/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 15/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-13T21:15:51.148 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 30/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 31/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 32/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-13T21:15:51.149 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-13T21:15:51.150 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-13T21:15:51.151 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-13T21:15:51.152 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-13T21:15:51.153 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-13T21:15:51.154 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-13T21:15:51.154 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-13T21:15:51.154 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-13T21:15:51.154 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-13T21:15:51.154 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-13T21:15:51.209 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-13T21:15:51.209 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout: ceph-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout: ceph-grafana-dashboards-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mds-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.210 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-k8sevents-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-modules-core-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: ceph-mon-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: ceph-osd-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: ceph-prometheus-alerts-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: cephadm-2:20.2.0-690.g3baf6bae.el9.noarch 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T21:15:51.211 INFO:teuthology.orchestra.run.trial012.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T21:15:51.212 INFO:teuthology.orchestra.run.trial012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T21:15:51.213 INFO:teuthology.orchestra.run.trial012.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T21:15:51.214 INFO:teuthology.orchestra.run.trial012.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T21:15:51.215 INFO:teuthology.orchestra.run.trial012.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T21:15:51.216 INFO:teuthology.orchestra.run.trial012.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-13T21:15:51.217 INFO:teuthology.orchestra.run.trial012.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-13T21:15:51.218 INFO:teuthology.orchestra.run.trial012.stdout: zip-3.0-35.el9.x86_64 2026-02-13T21:15:51.218 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:51.218 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:51.267 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-base 2026-02-13T21:15:51.570 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:04 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:51.636 INFO:teuthology.orchestra.run.trial012.stdout:Package ceph-base-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:51.654 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:51.655 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:51.655 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:51.676 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install cephadm 2026-02-13T21:15:51.975 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:04 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:52.040 INFO:teuthology.orchestra.run.trial012.stdout:Package cephadm-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:52.058 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:52.058 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:52.059 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:52.080 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-immutable-object-cache 2026-02-13T21:15:52.382 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:05 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:52.467 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:52.467 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout: Package Arch Version Repo Size 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 154 k 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout:Install 1 Package 2026-02-13T21:15:52.468 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:52.469 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 154 k 2026-02-13T21:15:52.469 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 447 k 2026-02-13T21:15:52.469 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:15:52.634 INFO:teuthology.orchestra.run.trial012.stdout:ceph-immutable-object-cache-20.2.0-690.g3baf6ba 929 kB/s | 154 kB 00:00 2026-02-13T21:15:52.634 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:52.634 INFO:teuthology.orchestra.run.trial012.stdout:Total 923 kB/s | 154 kB 00:00 2026-02-13T21:15:52.634 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:15:52.638 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:15:52.639 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:15:52.671 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:15:52.671 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:15:52.726 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:15:52.728 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-690.g3baf6bae.e 1/1 2026-02-13T21:15:52.751 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-690.g3baf6bae.e 1/1 2026-02-13T21:15:52.752 INFO:teuthology.orchestra.run.trial012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:15:52.752 INFO:teuthology.orchestra.run.trial012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T21:15:52.752 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:53.071 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-690.g3baf6bae.e 1/1 2026-02-13T21:15:53.072 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:53.072 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:15:53.072 INFO:teuthology.orchestra.run.trial012.stdout: ceph-immutable-object-cache-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:53.072 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:53.072 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:53.099 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-mgr 2026-02-13T21:15:53.404 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:06 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:53.470 INFO:teuthology.orchestra.run.trial012.stdout:Package ceph-mgr-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:53.489 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:53.489 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:53.489 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:53.511 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-mgr-dashboard 2026-02-13T21:15:53.818 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:06 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:53.884 INFO:teuthology.orchestra.run.trial012.stdout:Package ceph-mgr-dashboard-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:53.902 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:53.903 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:53.903 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:53.925 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-13T21:15:54.234 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:07 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:54.299 INFO:teuthology.orchestra.run.trial012.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:54.317 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:54.317 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:54.318 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:54.340 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-mgr-rook 2026-02-13T21:15:54.644 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:07 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:54.708 INFO:teuthology.orchestra.run.trial012.stdout:Package ceph-mgr-rook-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:54.726 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:54.727 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:54.727 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:54.749 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-mgr-cephadm 2026-02-13T21:15:55.055 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:08 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:55.122 INFO:teuthology.orchestra.run.trial012.stdout:Package ceph-mgr-cephadm-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:55.140 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:55.141 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:55.141 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:55.163 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-fuse 2026-02-13T21:15:55.465 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:08 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:55.551 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:55.551 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout: Package Architecture Version Repository Size 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout: ceph-fuse x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 939 k 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout:Install 1 Package 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 939 k 2026-02-13T21:15:55.552 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 2.7 M 2026-02-13T21:15:55.553 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:15:56.616 INFO:teuthology.orchestra.run.trial012.stdout:ceph-fuse-20.2.0-690.g3baf6bae.el9.x86_64.rpm 882 kB/s | 939 kB 00:01 2026-02-13T21:15:56.617 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:56.617 INFO:teuthology.orchestra.run.trial012.stdout:Total 881 kB/s | 939 kB 00:01 2026-02-13T21:15:56.617 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:15:56.622 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:15:56.622 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:15:56.656 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:15:56.656 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:15:56.746 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:15:56.763 INFO:teuthology.orchestra.run.trial012.stdout: Installing : ceph-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:57.008 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: ceph-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:57.065 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : ceph-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:57.065 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:57.065 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:15:57.065 INFO:teuthology.orchestra.run.trial012.stdout: ceph-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:57.065 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:57.065 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:57.093 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install ceph-volume 2026-02-13T21:15:57.408 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:10 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:57.473 INFO:teuthology.orchestra.run.trial012.stdout:Package ceph-volume-2:20.2.0-690.g3baf6bae.el9.noarch is already installed. 2026-02-13T21:15:57.491 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:57.492 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:57.492 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:57.514 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install librados-devel 2026-02-13T21:15:57.822 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:10 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:57.906 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:57.906 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:57.906 INFO:teuthology.orchestra.run.trial012.stdout: Package Arch Version Repo Size 2026-02-13T21:15:57.906 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:57.906 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:15:57.906 INFO:teuthology.orchestra.run.trial012.stdout: librados-devel x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 126 k 2026-02-13T21:15:57.906 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:57.907 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:15:57.907 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:57.907 INFO:teuthology.orchestra.run.trial012.stdout:Install 1 Package 2026-02-13T21:15:57.907 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:57.907 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 126 k 2026-02-13T21:15:57.907 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 449 k 2026-02-13T21:15:57.907 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:15:58.309 INFO:teuthology.orchestra.run.trial012.stdout:librados-devel-20.2.0-690.g3baf6bae.el9.x86_64. 312 kB/s | 126 kB 00:00 2026-02-13T21:15:58.311 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:58.311 INFO:teuthology.orchestra.run.trial012.stdout:Total 311 kB/s | 126 kB 00:00 2026-02-13T21:15:58.311 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:15:58.314 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:15:58.314 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:15:58.346 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:15:58.347 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:15:58.401 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:15:58.418 INFO:teuthology.orchestra.run.trial012.stdout: Installing : librados-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:58.496 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: librados-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:58.554 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : librados-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:58.554 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:58.554 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:15:58.555 INFO:teuthology.orchestra.run.trial012.stdout: librados-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:58.555 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:58.555 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:58.584 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install libcephfs2 2026-02-13T21:15:58.889 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:11 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:58.954 INFO:teuthology.orchestra.run.trial012.stdout:Package libcephfs2-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:15:58.972 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:58.972 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:15:58.973 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:58.994 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install libcephfs-devel 2026-02-13T21:15:59.305 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:12 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:15:59.391 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:15:59.391 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:59.392 INFO:teuthology.orchestra.run.trial012.stdout: Package Arch Version Repo Size 2026-02-13T21:15:59.392 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:59.392 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:15:59.392 INFO:teuthology.orchestra.run.trial012.stdout: libcephfs-devel x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 34 k 2026-02-13T21:15:59.392 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:59.392 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:15:59.392 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:15:59.392 INFO:teuthology.orchestra.run.trial012.stdout:Install 1 Package 2026-02-13T21:15:59.393 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:59.393 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 34 k 2026-02-13T21:15:59.393 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 155 k 2026-02-13T21:15:59.393 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:15:59.453 INFO:teuthology.orchestra.run.trial012.stdout:libcephfs-devel-20.2.0-690.g3baf6bae.el9.x86_64 558 kB/s | 34 kB 00:00 2026-02-13T21:15:59.454 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:15:59.454 INFO:teuthology.orchestra.run.trial012.stdout:Total 550 kB/s | 34 kB 00:00 2026-02-13T21:15:59.454 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:15:59.455 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:15:59.456 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:15:59.458 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:15:59.458 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:15:59.479 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:15:59.495 INFO:teuthology.orchestra.run.trial012.stdout: Installing : libcephfs-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:59.549 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:59.607 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libcephfs-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:15:59.607 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:59.608 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:15:59.608 INFO:teuthology.orchestra.run.trial012.stdout: libcephfs-devel-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:15:59.608 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:15:59.608 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:15:59.636 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install librados2 2026-02-13T21:15:59.941 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:12 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:00.006 INFO:teuthology.orchestra.run.trial012.stdout:Package librados2-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:16:00.025 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:00.026 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:16:00.026 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:00.047 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install librbd1 2026-02-13T21:16:00.347 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:00.413 INFO:teuthology.orchestra.run.trial012.stdout:Package librbd1-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:16:00.431 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:00.432 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:16:00.432 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:00.453 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install python3-rados 2026-02-13T21:16:00.760 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:00.826 INFO:teuthology.orchestra.run.trial012.stdout:Package python3-rados-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:16:00.844 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:00.845 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:16:00.845 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:00.867 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install python3-rgw 2026-02-13T21:16:01.170 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:01.235 INFO:teuthology.orchestra.run.trial012.stdout:Package python3-rgw-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:16:01.253 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:01.254 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:16:01.254 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:01.277 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install python3-cephfs 2026-02-13T21:16:01.586 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:01.653 INFO:teuthology.orchestra.run.trial012.stdout:Package python3-cephfs-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:16:01.672 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:01.673 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:16:01.673 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:01.695 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install python3-rbd 2026-02-13T21:16:02.000 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:02.066 INFO:teuthology.orchestra.run.trial012.stdout:Package python3-rbd-2:20.2.0-690.g3baf6bae.el9.x86_64 is already installed. 2026-02-13T21:16:02.085 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:02.086 INFO:teuthology.orchestra.run.trial012.stdout:Nothing to do. 2026-02-13T21:16:02.086 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:02.107 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install rbd-fuse 2026-02-13T21:16:02.409 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:15 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:02.495 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:02.495 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:02.495 INFO:teuthology.orchestra.run.trial012.stdout: Package Architecture Version Repository Size 2026-02-13T21:16:02.495 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:02.495 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:16:02.495 INFO:teuthology.orchestra.run.trial012.stdout: rbd-fuse x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 91 k 2026-02-13T21:16:02.495 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:02.495 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:16:02.496 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:02.496 INFO:teuthology.orchestra.run.trial012.stdout:Install 1 Package 2026-02-13T21:16:02.496 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:02.496 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 91 k 2026-02-13T21:16:02.496 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 238 k 2026-02-13T21:16:02.496 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:16:02.568 INFO:teuthology.orchestra.run.trial012.stdout:rbd-fuse-20.2.0-690.g3baf6bae.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-13T21:16:02.569 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:16:02.569 INFO:teuthology.orchestra.run.trial012.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-13T21:16:02.569 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:16:02.573 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:16:02.573 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:16:02.606 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:16:02.606 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:16:02.657 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:16:02.674 INFO:teuthology.orchestra.run.trial012.stdout: Installing : rbd-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:02.756 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: rbd-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:02.814 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : rbd-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:02.814 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:02.814 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:16:02.814 INFO:teuthology.orchestra.run.trial012.stdout: rbd-fuse-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:16:02.814 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:02.815 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:02.843 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install rbd-mirror 2026-02-13T21:16:03.152 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:16 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:03.238 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:03.238 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:03.239 INFO:teuthology.orchestra.run.trial012.stdout: Package Arch Version Repo Size 2026-02-13T21:16:03.239 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:03.239 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:16:03.239 INFO:teuthology.orchestra.run.trial012.stdout: rbd-mirror x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 2.9 M 2026-02-13T21:16:03.239 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:03.240 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:16:03.240 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:03.240 INFO:teuthology.orchestra.run.trial012.stdout:Install 1 Package 2026-02-13T21:16:03.240 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:03.240 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 2.9 M 2026-02-13T21:16:03.240 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 11 M 2026-02-13T21:16:03.241 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:16:03.387 INFO:teuthology.orchestra.run.trial012.stdout:rbd-mirror-20.2.0-690.g3baf6bae.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-13T21:16:03.387 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:16:03.387 INFO:teuthology.orchestra.run.trial012.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-13T21:16:03.387 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:16:03.392 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:16:03.393 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:16:03.435 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:16:03.435 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:16:03.617 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:16:03.618 INFO:teuthology.orchestra.run.trial012.stdout: Installing : rbd-mirror-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:03.643 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: rbd-mirror-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:03.643 INFO:teuthology.orchestra.run.trial012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T21:16:03.643 INFO:teuthology.orchestra.run.trial012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T21:16:03.643 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T21:16:03.643 INFO:teuthology.orchestra.run.trial012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T21:16:03.643 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:03.934 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : rbd-mirror-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:03.934 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:03.934 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:16:03.934 INFO:teuthology.orchestra.run.trial012.stdout: rbd-mirror-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:16:03.935 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:03.935 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:03.962 DEBUG:teuthology.orchestra.run.trial012:> sudo yum -y install rbd-nbd 2026-02-13T21:16:04.267 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:16:04.351 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:16:04.352 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:04.352 INFO:teuthology.orchestra.run.trial012.stdout: Package Architecture Version Repository Size 2026-02-13T21:16:04.352 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:04.352 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:16:04.352 INFO:teuthology.orchestra.run.trial012.stdout: rbd-nbd x86_64 2:20.2.0-690.g3baf6bae.el9 ceph 180 k 2026-02-13T21:16:04.352 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:04.353 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:16:04.353 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:16:04.353 INFO:teuthology.orchestra.run.trial012.stdout:Install 1 Package 2026-02-13T21:16:04.353 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:04.353 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 180 k 2026-02-13T21:16:04.353 INFO:teuthology.orchestra.run.trial012.stdout:Installed size: 498 k 2026-02-13T21:16:04.353 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:16:04.437 INFO:teuthology.orchestra.run.trial012.stdout:rbd-nbd-20.2.0-690.g3baf6bae.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-13T21:16:04.438 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:16:04.438 INFO:teuthology.orchestra.run.trial012.stdout:Total 2.0 MB/s | 180 kB 00:00 2026-02-13T21:16:04.438 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:16:04.442 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:16:04.443 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:16:04.475 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:16:04.475 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:16:04.532 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:16:04.549 INFO:teuthology.orchestra.run.trial012.stdout: Installing : rbd-nbd-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:04.630 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: rbd-nbd-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:04.688 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : rbd-nbd-2:20.2.0-690.g3baf6bae.el9.x86_64 1/1 2026-02-13T21:16:04.689 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:04.689 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:16:04.689 INFO:teuthology.orchestra.run.trial012.stdout: rbd-nbd-2:20.2.0-690.g3baf6bae.el9.x86_64 2026-02-13T21:16:04.689 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:04.689 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:16:04.721 DEBUG:teuthology.parallel:result is None 2026-02-13T21:16:04.722 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:16:04.897 DEBUG:teuthology.orchestra.run.trial012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T21:16:04.919 INFO:teuthology.orchestra.run.trial012.stdout:20.2.0-690.g3baf6bae.el9 2026-02-13T21:16:04.920 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-690.g3baf6bae.el9 2026-02-13T21:16:04.920 INFO:teuthology.task.install:The correct ceph version 20.2.0-690.g3baf6bae is installed. 2026-02-13T21:16:04.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:16:05.073 DEBUG:teuthology.orchestra.run.trial090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T21:16:05.094 INFO:teuthology.orchestra.run.trial090.stdout:20.2.0-690.g3baf6bae.el9 2026-02-13T21:16:05.095 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-690.g3baf6bae.el9 2026-02-13T21:16:05.095 INFO:teuthology.task.install:The correct ceph version 20.2.0-690.g3baf6bae is installed. 2026-02-13T21:16:05.096 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T21:16:05.096 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:05.096 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T21:16:05.122 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:16:05.122 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T21:16:05.159 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T21:16:05.160 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:05.160 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T21:16:05.187 DEBUG:teuthology.orchestra.run.trial012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T21:16:05.251 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:16:05.251 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T21:16:05.277 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T21:16:05.342 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T21:16:05.342 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:05.342 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T21:16:05.367 DEBUG:teuthology.orchestra.run.trial012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T21:16:05.431 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:16:05.431 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T21:16:05.457 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T21:16:05.521 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T21:16:05.522 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:05.522 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T21:16:05.547 DEBUG:teuthology.orchestra.run.trial012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T21:16:05.610 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:16:05.610 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T21:16:05.636 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T21:16:05.699 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T21:16:05.832 INFO:tasks.cephadm:Config: {'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering'], 'sha1': '3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33'} 2026-02-13T21:16:05.832 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:16:05.835 INFO:tasks.cephadm:Cluster fsid is 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:05.835 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T21:16:05.835 INFO:tasks.cephadm:No mon roles; fabricating mons 2026-02-13T21:16:05.835 INFO:tasks.cephadm:Monitor IPs: {'mon.trial012': '10.20.193.12', 'mon.trial090': '10.20.193.90'} 2026-02-13T21:16:05.835 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T21:16:05.836 DEBUG:teuthology.orchestra.run.trial012:> sudo hostname $(hostname -s) 2026-02-13T21:16:05.860 DEBUG:teuthology.orchestra.run.trial090:> sudo hostname $(hostname -s) 2026-02-13T21:16:05.884 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T21:16:05.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:16:06.024 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/flavors/default/', 'ref': 'wip-jcollin-testing-20260213.155635-tentacle', 'sha1': '3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-13 19:31:41.426309', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '20.2.0-690-g3baf6bae', 'package_manager_version': '20.2.0-690.g3baf6bae', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2975/', 'root_build_cause': '', 'node_name': '10.20.192.98+toko08', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T21:16:06.166 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-jcollin-testing-20260213.155635-tentacle, sha1 3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:16:06.167 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/x86_64/flavors/default/cephadm 2026-02-13T21:16:06.167 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/x86_64/flavors/default/cephadm 2026-02-13T21:16:06.167 DEBUG:teuthology.orchestra.run.trial012:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T21:16:06.433 INFO:teuthology.orchestra.run.trial012.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054086 Feb 13 21:16 /home/ubuntu/cephtest/cephadm 2026-02-13T21:16:06.434 DEBUG:teuthology.orchestra.run.trial090:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260213.155635-tentacle/3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T21:16:06.703 INFO:teuthology.orchestra.run.trial090.stdout:-rw-r--r--. 1 ubuntu ubuntu 1054086 Feb 13 21:16 /home/ubuntu/cephtest/cephadm 2026-02-13T21:16:06.703 DEBUG:teuthology.orchestra.run.trial012:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T21:16:06.721 DEBUG:teuthology.orchestra.run.trial090:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T21:16:06.755 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 on all hosts... 2026-02-13T21:16:06.755 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 pull 2026-02-13T21:16:06.763 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 pull 2026-02-13T21:16:06.916 INFO:teuthology.orchestra.run.trial012.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33... 2026-02-13T21:16:06.918 INFO:teuthology.orchestra.run.trial090.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33... 2026-02-13T21:16:17.200 INFO:teuthology.orchestra.run.trial012.stdout:{ 2026-02-13T21:16:17.200 INFO:teuthology.orchestra.run.trial012.stdout: "ceph_version": "ceph version 20.2.0-690-g3baf6bae (3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) tentacle (stable)", 2026-02-13T21:16:17.200 INFO:teuthology.orchestra.run.trial012.stdout: "image_id": "c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185", 2026-02-13T21:16:17.200 INFO:teuthology.orchestra.run.trial012.stdout: "repo_digests": [ 2026-02-13T21:16:17.201 INFO:teuthology.orchestra.run.trial012.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06" 2026-02-13T21:16:17.201 INFO:teuthology.orchestra.run.trial012.stdout: ] 2026-02-13T21:16:17.201 INFO:teuthology.orchestra.run.trial012.stdout:} 2026-02-13T21:16:17.333 INFO:teuthology.orchestra.run.trial090.stdout:{ 2026-02-13T21:16:17.334 INFO:teuthology.orchestra.run.trial090.stdout: "ceph_version": "ceph version 20.2.0-690-g3baf6bae (3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) tentacle (stable)", 2026-02-13T21:16:17.334 INFO:teuthology.orchestra.run.trial090.stdout: "image_id": "c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185", 2026-02-13T21:16:17.334 INFO:teuthology.orchestra.run.trial090.stdout: "repo_digests": [ 2026-02-13T21:16:17.334 INFO:teuthology.orchestra.run.trial090.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06" 2026-02-13T21:16:17.334 INFO:teuthology.orchestra.run.trial090.stdout: ] 2026-02-13T21:16:17.334 INFO:teuthology.orchestra.run.trial090.stdout:} 2026-02-13T21:16:17.350 DEBUG:teuthology.orchestra.run.trial012:> sudo mkdir -p /etc/ceph 2026-02-13T21:16:17.379 DEBUG:teuthology.orchestra.run.trial090:> sudo mkdir -p /etc/ceph 2026-02-13T21:16:17.426 DEBUG:teuthology.orchestra.run.trial012:> sudo chmod 777 /etc/ceph 2026-02-13T21:16:17.451 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 777 /etc/ceph 2026-02-13T21:16:17.475 INFO:tasks.cephadm:Writing seed config... 2026-02-13T21:16:17.477 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T21:16:17.477 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T21:16:17.477 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T21:16:17.477 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T21:16:17.477 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T21:16:17.477 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T21:16:17.477 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T21:16:17.478 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T21:16:17.478 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T21:16:17.479 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:17.479 DEBUG:teuthology.orchestra.run.trial012:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T21:16:17.507 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3551db35-0921-11f1-800a-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-13T21:16:17.508 DEBUG:teuthology.orchestra.run.trial012:mon.trial012> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial012.service 2026-02-13T21:16:17.549 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T21:16:17.550 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 -v bootstrap --fsid 3551db35-0921-11f1-800a-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 10.20.193.12 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T21:16:17.689 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:16:17.689 INFO:teuthology.orchestra.run.trial012.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', '-v', 'bootstrap', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '10.20.193.12', '--skip-admin-label'] 2026-02-13T21:16:17.690 INFO:teuthology.orchestra.run.trial012.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T21:16:17.690 INFO:teuthology.orchestra.run.trial012.stdout:Verifying podman|docker is present... 2026-02-13T21:16:17.706 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stdout 5.6.0 2026-02-13T21:16:17.706 INFO:teuthology.orchestra.run.trial012.stdout:Verifying lvm2 is present... 2026-02-13T21:16:17.706 INFO:teuthology.orchestra.run.trial012.stdout:Verifying time synchronization is in place... 2026-02-13T21:16:17.712 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T21:16:17.712 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T21:16:17.718 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T21:16:17.718 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout inactive 2026-02-13T21:16:17.724 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout enabled 2026-02-13T21:16:17.730 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout active 2026-02-13T21:16:17.730 INFO:teuthology.orchestra.run.trial012.stdout:Unit chronyd.service is enabled and running 2026-02-13T21:16:17.730 INFO:teuthology.orchestra.run.trial012.stdout:Repeating the final host check... 2026-02-13T21:16:17.747 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stdout 5.6.0 2026-02-13T21:16:17.747 INFO:teuthology.orchestra.run.trial012.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T21:16:17.747 INFO:teuthology.orchestra.run.trial012.stdout:systemctl is present 2026-02-13T21:16:17.747 INFO:teuthology.orchestra.run.trial012.stdout:lvcreate is present 2026-02-13T21:16:17.752 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T21:16:17.752 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T21:16:17.757 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T21:16:17.757 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout inactive 2026-02-13T21:16:17.763 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout enabled 2026-02-13T21:16:17.769 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout active 2026-02-13T21:16:17.769 INFO:teuthology.orchestra.run.trial012.stdout:Unit chronyd.service is enabled and running 2026-02-13T21:16:17.769 INFO:teuthology.orchestra.run.trial012.stdout:Host looks OK 2026-02-13T21:16:17.769 INFO:teuthology.orchestra.run.trial012.stdout:Cluster fsid: 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:17.769 INFO:teuthology.orchestra.run.trial012.stdout:Acquiring lock 139688400773184 on /run/cephadm/3551db35-0921-11f1-800a-d404e6e7d460.lock 2026-02-13T21:16:17.769 INFO:teuthology.orchestra.run.trial012.stdout:Lock 139688400773184 acquired on /run/cephadm/3551db35-0921-11f1-800a-d404e6e7d460.lock 2026-02-13T21:16:17.770 INFO:teuthology.orchestra.run.trial012.stdout:Verifying IP 10.20.193.12 port 3300 ... 2026-02-13T21:16:17.770 INFO:teuthology.orchestra.run.trial012.stdout:Verifying IP 10.20.193.12 port 6789 ... 2026-02-13T21:16:17.770 INFO:teuthology.orchestra.run.trial012.stdout:Base mon IP(s) is [10.20.193.12:3300, 10.20.193.12:6789], mon addrv is [v2:10.20.193.12:3300,v1:10.20.193.12:6789] 2026-02-13T21:16:17.772 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.12 metric 102 2026-02-13T21:16:17.773 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.12 metric 102 2026-02-13T21:16:17.773 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-13T21:16:17.775 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-13T21:16:17.775 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-13T21:16:17.775 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout inet6 fe80::f16d:8cdc:ee46:29f9/64 scope link noprefixroute 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6242/64 scope link 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:Mon IP `10.20.193.12` is in CIDR network `10.20.192.0/20` 2026-02-13T21:16:17.779 INFO:teuthology.orchestra.run.trial012.stdout:Mon IP `10.20.193.12` is in CIDR network `10.20.192.0/20` 2026-02-13T21:16:17.780 INFO:teuthology.orchestra.run.trial012.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T21:16:17.780 INFO:teuthology.orchestra.run.trial012.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T21:16:17.780 INFO:teuthology.orchestra.run.trial012.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33... 2026-02-13T21:16:18.043 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stdout c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 2026-02-13T21:16:18.043 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33... 2026-02-13T21:16:18.043 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T21:16:18.043 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stderr Copying blob sha256:9958a91d03e41bf25f387cce5eae1cc2b1a7405d272c941fbda91919b7ad654f 2026-02-13T21:16:18.043 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stderr Copying blob sha256:f288f3bfe1f1dd15cb8f17590a708af9d9397de617368b4f9c06e9bc583d4a6b 2026-02-13T21:16:18.043 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stderr Copying config sha256:c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 2026-02-13T21:16:18.044 INFO:teuthology.orchestra.run.trial012.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T21:16:18.173 INFO:teuthology.orchestra.run.trial012.stdout:ceph: stdout ceph version 20.2.0-690-g3baf6bae (3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) tentacle (stable) 2026-02-13T21:16:18.174 INFO:teuthology.orchestra.run.trial012.stdout:Ceph version: ceph version 20.2.0-690-g3baf6bae (3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) tentacle (stable) 2026-02-13T21:16:18.174 INFO:teuthology.orchestra.run.trial012.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T21:16:18.297 INFO:teuthology.orchestra.run.trial012.stdout:stat: stdout 167 167 2026-02-13T21:16:18.297 INFO:teuthology.orchestra.run.trial012.stdout:Creating initial keys... 2026-02-13T21:16:18.438 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph-authtool: stdout AQCilI9pu1lCGRAAVk4pn0e7Sxd+L41jZX2ZSw== 2026-02-13T21:16:18.578 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph-authtool: stdout AQCilI9pEo/jIBAAnKQevaNRf91AU0JMwxHlyA== 2026-02-13T21:16:18.696 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph-authtool: stdout AQCilI9pIueWKBAAsvZbmg01krA9npJpH4a8tg== 2026-02-13T21:16:18.697 INFO:teuthology.orchestra.run.trial012.stdout:Creating initial monmap... 2026-02-13T21:16:18.838 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T21:16:18.838 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T21:16:18.838 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:18.839 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T21:16:18.839 INFO:teuthology.orchestra.run.trial012.stdout:monmaptool for trial012 [v2:10.20.193.12:3300,v1:10.20.193.12:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T21:16:18.839 INFO:teuthology.orchestra.run.trial012.stdout:setting min_mon_release = tentacle 2026-02-13T21:16:18.839 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/monmaptool: set fsid to 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:18.839 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T21:16:18.839 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:18.839 INFO:teuthology.orchestra.run.trial012.stdout:Creating mon... 2026-02-13T21:16:18.969 INFO:teuthology.orchestra.run.trial012.stdout:create mon.trial012 on 2026-02-13T21:16:19.145 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-13T21:16:19.243 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-13T21:16:19.347 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3551db35-0921-11f1-800a-d404e6e7d460.target → /etc/systemd/system/ceph-3551db35-0921-11f1-800a-d404e6e7d460.target. 2026-02-13T21:16:19.348 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3551db35-0921-11f1-800a-d404e6e7d460.target → /etc/systemd/system/ceph-3551db35-0921-11f1-800a-d404e6e7d460.target. 2026-02-13T21:16:19.477 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial012 2026-02-13T21:16:19.477 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial012.service: Unit ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial012.service not loaded. 2026-02-13T21:16:19.595 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3551db35-0921-11f1-800a-d404e6e7d460.target.wants/ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial012.service → /etc/systemd/system/ceph-3551db35-0921-11f1-800a-d404e6e7d460@.service. 2026-02-13T21:16:19.609 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 systemd[1]: Starting Ceph mon.trial012 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:16:19.735 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T21:16:19.735 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout disabled 2026-02-13T21:16:19.742 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T21:16:19.742 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout inactive 2026-02-13T21:16:19.742 INFO:teuthology.orchestra.run.trial012.stdout:firewalld.service is not enabled 2026-02-13T21:16:19.742 INFO:teuthology.orchestra.run.trial012.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T21:16:19.743 INFO:teuthology.orchestra.run.trial012.stdout:Waiting for mon to start... 2026-02-13T21:16:19.743 INFO:teuthology.orchestra.run.trial012.stdout:Waiting for mon... 2026-02-13T21:16:19.899 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 podman[37461]: 2026-02-13 21:16:19.687594993 +0000 UTC m=+0.015950616 container create b3077ad33e995c04574954796a17b032bd2a50b0da1e97ff1cf0d8e43d8a4e0f (image=quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260209, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) 2026-02-13T21:16:19.900 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 podman[37461]: 2026-02-13 21:16:19.717209265 +0000 UTC m=+0.045564898 container init b3077ad33e995c04574954796a17b032bd2a50b0da1e97ff1cf0d8e43d8a4e0f (image=quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012, org.label-schema.license=GPLv2, org.label-schema.build-date=20260209, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-13T21:16:19.900 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 podman[37461]: 2026-02-13 21:16:19.719418528 +0000 UTC m=+0.047774161 container start b3077ad33e995c04574954796a17b032bd2a50b0da1e97ff1cf0d8e43d8a4e0f (image=quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-13T21:16:19.900 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 bash[37461]: b3077ad33e995c04574954796a17b032bd2a50b0da1e97ff1cf0d8e43d8a4e0f 2026-02-13T21:16:19.900 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 podman[37461]: 2026-02-13 21:16:19.681266078 +0000 UTC m=+0.009621711 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:16:19.900 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 systemd[1]: Started Ceph mon.trial012 for 3551db35-0921-11f1-800a-d404e6e7d460. 2026-02-13T21:16:19.900 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 ceph-mon[37491]: mkfs 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:19.900 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:19 trial012 ceph-mon[37491]: mon.trial012 is new leader, mons trial012 in quorum (ranks 0) 2026-02-13T21:16:19.918 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T21:16:19.918 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout id: 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout services: 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum trial012 (age 0.139511s) [leader: trial012] 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout data: 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:mon is available 2026-02-13T21:16:19.919 INFO:teuthology.orchestra.run.trial012.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T21:16:20.080 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:20.080 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T21:16:20.080 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout fsid = 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:20.080 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T21:16:20.080 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.12:3300,v1:10.20.193.12:6789] 2026-02-13T21:16:20.080 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T21:16:20.080 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T21:16:20.080 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T21:16:20.081 INFO:teuthology.orchestra.run.trial012.stdout:Generating new minimal ceph.conf... 2026-02-13T21:16:20.243 INFO:teuthology.orchestra.run.trial012.stdout:Restarting the monitor... 2026-02-13T21:16:20.573 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 systemd[1]: Stopping Ceph mon.trial012 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:16:20.573 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012[37487]: 2026-02-13T21:16:20.317+0000 7f98a21ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial012 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T21:16:20.573 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012[37487]: 2026-02-13T21:16:20.317+0000 7f98a21ab640 -1 mon.trial012@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T21:16:20.756 INFO:teuthology.orchestra.run.trial012.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T21:16:20.838 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 podman[37777]: 2026-02-13 21:16:20.571535991 +0000 UTC m=+0.265905483 container died b3077ad33e995c04574954796a17b032bd2a50b0da1e97ff1cf0d8e43d8a4e0f (image=quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260209, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=debug, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True) 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 podman[37777]: 2026-02-13 21:16:20.57957378 +0000 UTC m=+0.273943282 container remove b3077ad33e995c04574954796a17b032bd2a50b0da1e97ff1cf0d8e43d8a4e0f (image=quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 bash[37777]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 systemd[1]: ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial012.service: Deactivated successfully. 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 systemd[1]: Stopped Ceph mon.trial012 for 3551db35-0921-11f1-800a-d404e6e7d460. 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 systemd[1]: Starting Ceph mon.trial012 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 podman[37901]: 2026-02-13 21:16:20.72413449 +0000 UTC m=+0.015602028 container create ee692368d751d573853e148c9a24b3a2d858408afb61b92bd5f1c70702edb2dc (image=quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 podman[37901]: 2026-02-13 21:16:20.74770629 +0000 UTC m=+0.039173838 container init ee692368d751d573853e148c9a24b3a2d858408afb61b92bd5f1c70702edb2dc (image=quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug) 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 podman[37901]: 2026-02-13 21:16:20.750241598 +0000 UTC m=+0.041709126 container start ee692368d751d573853e148c9a24b3a2d858408afb61b92bd5f1c70702edb2dc (image=quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, OSD_FLAVOR=debug) 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 bash[37901]: ee692368d751d573853e148c9a24b3a2d858408afb61b92bd5f1c70702edb2dc 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 podman[37901]: 2026-02-13 21:16:20.717878391 +0000 UTC m=+0.009345929 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 systemd[1]: Started Ceph mon.trial012 for 3551db35-0921-11f1-800a-d404e6e7d460. 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: ceph version 20.2.0-690-g3baf6bae (3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: pidfile_write: ignore empty --pid-file 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: load: jerasure load: lrc 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: RocksDB version: 7.9.2 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Git sha 0 2026-02-13T21:16:20.839 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Compile date 2026-02-13 20:26:06 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: DB SUMMARY 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: DB Session ID: UFGDUDQJEOG9RVZIZQ3Q 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: CURRENT file: CURRENT 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: SST files in /var/lib/ceph/mon/ceph-trial012/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-trial012/store.db: 000009.log size: 76619 ; 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.error_if_exists: 0 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.create_if_missing: 0 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.paranoid_checks: 1 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.env: 0x55edb2145100 2026-02-13T21:16:20.840 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.info_log: 0x55edb8125d60 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.statistics: (nil) 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.use_fsync: 0 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_log_file_size: 0 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.allow_fallocate: 1 2026-02-13T21:16:20.841 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.use_direct_reads: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.db_log_dir: 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.wal_dir: 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.write_buffer_manager: 0x55edb8128500 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T21:16:20.842 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.unordered_write: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.row_cache: None 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.wal_filter: None 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.two_write_queues: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.wal_compression: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.atomic_flush: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.log_readahead_size: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T21:16:20.843 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_background_jobs: 2 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_background_compactions: -1 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_subcompactions: 1 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_open_files: -1 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_background_flushes: -1 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Compression algorithms supported: 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: kZSTD supported: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: kXpressCompression supported: 0 2026-02-13T21:16:20.844 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: kBZip2Compression supported: 0 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: kLZ4Compression supported: 1 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: kZlibCompression supported: 1 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: kSnappyCompression supported: 1 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-trial012/store.db/MANIFEST-000010 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.merge_operator: 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_filter: None 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55edb8124520) 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout: cache_index_and_filter_blocks: 1 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout: pin_top_level_index_and_filter: 1 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout: index_type: 0 2026-02-13T21:16:20.845 INFO:journalctl@ceph.mon.trial012.trial012.stdout: data_block_index_type: 0 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: index_shortening: 1 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: checksum: 4 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: no_block_cache: 0 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: block_cache: 0x55edb8145b90 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: block_cache_name: BinnedLRUCache 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: block_cache_options: 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: capacity : 536870912 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: num_shard_bits : 4 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: strict_capacity_limit : 0 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: high_pri_pool_ratio: 0.000 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: block_cache_compressed: (nil) 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: persistent_cache: (nil) 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: block_size: 4096 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: block_size_deviation: 10 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: block_restart_interval: 16 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: index_block_restart_interval: 1 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: metadata_block_size: 4096 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: partition_filters: 0 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: use_delta_encoding: 1 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: filter_policy: bloomfilter 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: whole_key_filtering: 1 2026-02-13T21:16:20.846 INFO:journalctl@ceph.mon.trial012.trial012.stdout: verify_compression: 0 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout: read_amp_bytes_per_bit: 0 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout: format_version: 5 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout: enable_index_compression: 1 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout: block_align: 0 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout: max_auto_readahead_size: 262144 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout: prepopulate_block_cache: 0 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout: initial_auto_readahead_size: 8192 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression: NoCompression 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.num_levels: 7 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T21:16:20.847 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T21:16:20.848 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T21:16:20.849 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.inplace_update_support: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.bloom_locality: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.max_successive_merges: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.ttl: 2592000 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.enable_blob_files: false 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.min_blob_size: 0 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T21:16:20.850 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-trial012/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7666ada7-8463-479d-bfa1-31a67caa5a97 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771017380778494, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771017380779314, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 73698, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 229, "table_properties": {"data_size": 71973, "index_size": 174, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9757, "raw_average_key_size": 48, "raw_value_size": 66426, "raw_average_value_size": 332, "num_data_blocks": 8, "num_entries": 200, "num_filter_entries": 200, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771017380, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7666ada7-8463-479d-bfa1-31a67caa5a97", "db_session_id": "UFGDUDQJEOG9RVZIZQ3Q", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771017380779369, "job": 1, "event": "recovery_finished"} 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-trial012/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55edb8148700 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: DB pointer 0x55edb815a000 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout: ** DB Stats ** 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T21:16:20.851 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: ** Compaction Stats [default] ** 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: L0 2/0 73.86 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Sum 2/0 73.86 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: ** Compaction Stats [default] ** 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 118.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T21:16:20.852 INFO:journalctl@ceph.mon.trial012.trial012.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Cumulative compaction: 0.00 GB write, 20.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Interval compaction: 0.00 GB write, 20.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Block cache BinnedLRUCache@0x55edb8145b90#2 capacity: 512.00 MB usage: 1.08 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.72 KB,0.000137091%) IndexBlock(2,0.36 KB,6.85453e-05%) Misc(1,0.00 KB,0%) 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: starting mon.trial012 rank 0 at public addrs [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] at bind addrs [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] mon_data /var/lib/ceph/mon/ceph-trial012 fsid 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012@-1(???) e1 preinit fsid 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012@-1(???).mds e1 new map 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012@-1(???).mds e1 print_map 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: e1 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: btime 2026-02-13T21:16:19:758535+0000 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: legacy client fscid: -1 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout: No filesystems configured 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T21:16:20.853 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mon.trial012 is new leader, mons trial012 in quorum (ranks 0) 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: monmap epoch 1 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: fsid 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: last_changed 2026-02-13T21:16:18.809061+0000 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: created 2026-02-13T21:16:18.809061+0000 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: min_mon_release 20 (tentacle) 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: election_strategy: 1 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: 0: [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] mon.trial012 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: fsmap 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T21:16:20.854 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:20 trial012 ceph-mon[37926]: mgrmap e1: no daemons active 2026-02-13T21:16:20.925 INFO:teuthology.orchestra.run.trial012.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T21:16:20.926 INFO:teuthology.orchestra.run.trial012.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T21:16:20.926 INFO:teuthology.orchestra.run.trial012.stdout:Creating mgr... 2026-02-13T21:16:20.926 INFO:teuthology.orchestra.run.trial012.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T21:16:20.926 INFO:teuthology.orchestra.run.trial012.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T21:16:20.926 INFO:teuthology.orchestra.run.trial012.stdout:Verifying port 0.0.0.0:8443 ... 2026-02-13T21:16:21.051 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3551db35-0921-11f1-800a-d404e6e7d460@mgr.trial012.zqhrrq 2026-02-13T21:16:21.051 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3551db35-0921-11f1-800a-d404e6e7d460@mgr.trial012.zqhrrq.service: Unit ceph-3551db35-0921-11f1-800a-d404e6e7d460@mgr.trial012.zqhrrq.service not loaded. 2026-02-13T21:16:21.164 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3551db35-0921-11f1-800a-d404e6e7d460.target.wants/ceph-3551db35-0921-11f1-800a-d404e6e7d460@mgr.trial012.zqhrrq.service → /etc/systemd/system/ceph-3551db35-0921-11f1-800a-d404e6e7d460@.service. 2026-02-13T21:16:21.310 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T21:16:21.310 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout disabled 2026-02-13T21:16:21.315 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T21:16:21.315 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout inactive 2026-02-13T21:16:21.315 INFO:teuthology.orchestra.run.trial012.stdout:firewalld.service is not enabled 2026-02-13T21:16:21.315 INFO:teuthology.orchestra.run.trial012.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T21:16:21.322 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T21:16:21.322 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout disabled 2026-02-13T21:16:21.328 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T21:16:21.328 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout inactive 2026-02-13T21:16:21.328 INFO:teuthology.orchestra.run.trial012.stdout:firewalld.service is not enabled 2026-02-13T21:16:21.328 INFO:teuthology.orchestra.run.trial012.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2026-02-13T21:16:21.328 INFO:teuthology.orchestra.run.trial012.stdout:Waiting for mgr to start... 2026-02-13T21:16:21.328 INFO:teuthology.orchestra.run.trial012.stdout:Waiting for mgr... 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout { 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "fsid": "3551db35-0921-11f1-800a-d404e6e7d460", 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T21:16:21.511 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 0 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "trial012" 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T21:16:21.512 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T21:16:19:758535+0000", 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:21.513 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T21:16:19.759260+0000", 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout } 2026-02-13T21:16:21.514 INFO:teuthology.orchestra.run.trial012.stdout:mgr not available, waiting (1/15)... 2026-02-13T21:16:22.317 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:21 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2719141451' entity='client.admin' 2026-02-13T21:16:22.317 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:21 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/467489501' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T21:16:23.679 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:23.679 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout { 2026-02-13T21:16:23.679 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "fsid": "3551db35-0921-11f1-800a-d404e6e7d460", 2026-02-13T21:16:23.679 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T21:16:23.679 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T21:16:23.679 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T21:16:23.679 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 0 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "trial012" 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T21:16:23.680 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T21:16:19:758535+0000", 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T21:16:23.681 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T21:16:19.759260+0000", 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout } 2026-02-13T21:16:23.682 INFO:teuthology.orchestra.run.trial012.stdout:mgr not available, waiting (2/15)... 2026-02-13T21:16:23.875 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:23 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2730412610' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T21:16:25.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: Activating manager daemon trial012.zqhrrq 2026-02-13T21:16:25.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: mgrmap e2: trial012.zqhrrq(active, starting, since 0.00343732s) 2026-02-13T21:16:25.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T21:16:25.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial012.zqhrrq", "id": "trial012.zqhrrq"} : dispatch 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: Manager daemon trial012.zqhrrq is now available 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/mirror_snapshot_schedule"} : dispatch 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/trash_purge_schedule"} : dispatch 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:25.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:24 trial012 ceph-mon[37926]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout { 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "fsid": "3551db35-0921-11f1-800a-d404e6e7d460", 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 0 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "trial012" 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T21:16:25.963 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:25.964 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T21:16:19:758535+0000", 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ], 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T21:16:19.759260+0000", 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout }, 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout } 2026-02-13T21:16:25.965 INFO:teuthology.orchestra.run.trial012.stdout:mgr is available 2026-02-13T21:16:26.204 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:26.204 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T21:16:26.204 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout fsid = 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.12:3300,v1:10.20.193.12:6789] 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T21:16:26.205 INFO:teuthology.orchestra.run.trial012.stdout:Enabling cephadm module... 2026-02-13T21:16:26.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:26 trial012 ceph-mon[37926]: mgrmap e3: trial012.zqhrrq(active, since 1.00586s) 2026-02-13T21:16:26.226 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:26 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/4215469502' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T21:16:27.369 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:27 trial012 ceph-mon[37926]: mgrmap e4: trial012.zqhrrq(active, since 2s) 2026-02-13T21:16:27.369 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:27 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3810687908' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T21:16:27.369 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:27 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3148838787' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T21:16:27.391 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout { 2026-02-13T21:16:27.391 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T21:16:27.392 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T21:16:27.392 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "active_name": "trial012.zqhrrq", 2026-02-13T21:16:27.392 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T21:16:27.392 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout } 2026-02-13T21:16:27.392 INFO:teuthology.orchestra.run.trial012.stdout:Waiting for the mgr to restart... 2026-02-13T21:16:27.392 INFO:teuthology.orchestra.run.trial012.stdout:Waiting for mgr epoch 5... 2026-02-13T21:16:28.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:28 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3148838787' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T21:16:28.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:28 trial012 ceph-mon[37926]: mgrmap e5: trial012.zqhrrq(active, since 3s) 2026-02-13T21:16:28.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:28 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/4164652635' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T21:16:30.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: Active manager daemon trial012.zqhrrq restarted 2026-02-13T21:16:30.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: Activating manager daemon trial012.zqhrrq 2026-02-13T21:16:30.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T21:16:30.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: mgrmap e6: trial012.zqhrrq(active, starting, since 0.00319584s) 2026-02-13T21:16:30.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:16:30.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial012.zqhrrq", "id": "trial012.zqhrrq"} : dispatch 2026-02-13T21:16:30.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T21:16:30.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T21:16:30.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T21:16:30.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:29 trial012 ceph-mon[37926]: Manager daemon trial012.zqhrrq is now available 2026-02-13T21:16:30.907 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout { 2026-02-13T21:16:30.907 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T21:16:30.908 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T21:16:30.908 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout } 2026-02-13T21:16:30.908 INFO:teuthology.orchestra.run.trial012.stdout:mgr epoch 5 is available 2026-02-13T21:16:30.908 INFO:teuthology.orchestra.run.trial012.stdout:Verifying orchestrator module is enabled... 2026-02-13T21:16:31.904 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T21:16:31.904 INFO:teuthology.orchestra.run.trial012.stdout:Setting orchestrator backend to cephadm... 2026-02-13T21:16:32.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: Found migration_current of "None". Setting to last migration. 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/mirror_snapshot_schedule"} : dispatch 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/trash_purge_schedule"} : dispatch 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T21:16:32.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: mgrmap e7: trial012.zqhrrq(active, since 1.00462s) 2026-02-13T21:16:32.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T21:16:32.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2726871551' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T21:16:32.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:31 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:16:32.391 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T21:16:32.391 INFO:teuthology.orchestra.run.trial012.stdout:Generating ssh key... 2026-02-13T21:16:32.887 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII8G4NwWg1ZdBzd6R/8qhenN3gjtHuhmTlLJugyTUFMc ceph-3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:32.888 INFO:teuthology.orchestra.run.trial012.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T21:16:32.888 INFO:teuthology.orchestra.run.trial012.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T21:16:32.888 INFO:teuthology.orchestra.run.trial012.stdout:Adding host trial012... 2026-02-13T21:16:32.932 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:31] ENGINE Bus STARTING 2026-02-13T21:16:32.932 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:31] ENGINE Serving on https://10.20.193.12:7150 2026-02-13T21:16:32.933 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:31] ENGINE Client ('10.20.193.12', 45142) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-13T21:16:32.933 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:31] ENGINE Serving on http://10.20.193.12:8765 2026-02-13T21:16:32.933 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:31] ENGINE Bus STARTED 2026-02-13T21:16:32.933 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2726871551' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T21:16:32.933 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: mgrmap e8: trial012.zqhrrq(active, since 2s) 2026-02-13T21:16:32.933 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:32.933 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:32.934 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:16:32.934 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:32.934 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:32 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:34.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:33 trial012 ceph-mon[37926]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:34.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:33 trial012 ceph-mon[37926]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:34.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:33 trial012 ceph-mon[37926]: Generating ssh key... 2026-02-13T21:16:34.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:33 trial012 ceph-mon[37926]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:34.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:33 trial012 ceph-mon[37926]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial012", "addr": "10.20.193.12", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:34.744 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Added host 'trial012' with addr '10.20.193.12' 2026-02-13T21:16:34.744 INFO:teuthology.orchestra.run.trial012.stdout:Deploying mon service with default placement... 2026-02-13T21:16:34.997 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:34 trial012 ceph-mon[37926]: Deploying cephadm binary to trial012 2026-02-13T21:16:34.997 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:34 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:34.997 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:34 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:16:35.017 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T21:16:35.017 INFO:teuthology.orchestra.run.trial012.stdout:Deploying mgr service with default placement... 2026-02-13T21:16:35.280 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T21:16:35.280 INFO:teuthology.orchestra.run.trial012.stdout:Deploying crash service with default placement... 2026-02-13T21:16:35.548 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2026-02-13T21:16:35.548 INFO:teuthology.orchestra.run.trial012.stdout:Deploying ceph-exporter service with default placement... 2026-02-13T21:16:35.822 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2026-02-13T21:16:35.822 INFO:teuthology.orchestra.run.trial012.stdout:Deploying prometheus service with default placement... 2026-02-13T21:16:36.062 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: Added host trial012 2026-02-13T21:16:36.062 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:36.062 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: Saving service mon spec with placement count:5 2026-02-13T21:16:36.062 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:36.062 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:36.062 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:36.063 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:36.063 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:36.063 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:36.063 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:35 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:36.087 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2026-02-13T21:16:36.087 INFO:teuthology.orchestra.run.trial012.stdout:Deploying grafana service with default placement... 2026-02-13T21:16:36.350 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2026-02-13T21:16:36.351 INFO:teuthology.orchestra.run.trial012.stdout:Deploying node-exporter service with default placement... 2026-02-13T21:16:36.610 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2026-02-13T21:16:36.610 INFO:teuthology.orchestra.run.trial012.stdout:Deploying alertmanager service with default placement... 2026-02-13T21:16:36.859 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2026-02-13T21:16:37.101 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:37.101 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: Saving service mgr spec with placement count:2 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: Saving service crash spec with placement * 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: Saving service ceph-exporter spec with placement * 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: Saving service prometheus spec with placement count:1 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:37.102 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:37 trial012 ceph-mon[37926]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:37.353 INFO:teuthology.orchestra.run.trial012.stdout:Enabling the dashboard module... 2026-02-13T21:16:38.344 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:38.345 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: Saving service grafana spec with placement count:1 2026-02-13T21:16:38.345 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:38.345 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: Saving service node-exporter spec with placement * 2026-02-13T21:16:38.345 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:38.345 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: Saving service alertmanager spec with placement count:1 2026-02-13T21:16:38.345 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3030499417' entity='client.admin' 2026-02-13T21:16:38.345 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1026232998' entity='client.admin' 2026-02-13T21:16:38.345 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:38 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1147694329' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-13T21:16:38.644 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout { 2026-02-13T21:16:38.644 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-13T21:16:38.644 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T21:16:38.644 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "active_name": "trial012.zqhrrq", 2026-02-13T21:16:38.645 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T21:16:38.645 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout } 2026-02-13T21:16:38.645 INFO:teuthology.orchestra.run.trial012.stdout:Waiting for the mgr to restart... 2026-02-13T21:16:38.645 INFO:teuthology.orchestra.run.trial012.stdout:Waiting for mgr epoch 9... 2026-02-13T21:16:39.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:39 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1147694329' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-13T21:16:39.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:39 trial012 ceph-mon[37926]: mgrmap e9: trial012.zqhrrq(active, since 8s) 2026-02-13T21:16:39.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:39 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1379723789' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: Active manager daemon trial012.zqhrrq restarted 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: Activating manager daemon trial012.zqhrrq 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: mgrmap e10: trial012.zqhrrq(active, starting, since 0.00304784s) 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial012.zqhrrq", "id": "trial012.zqhrrq"} : dispatch 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T21:16:41.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:41 trial012 ceph-mon[37926]: Manager daemon trial012.zqhrrq is now available 2026-02-13T21:16:42.191 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout { 2026-02-13T21:16:42.192 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-13T21:16:42.192 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T21:16:42.192 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout } 2026-02-13T21:16:42.192 INFO:teuthology.orchestra.run.trial012.stdout:mgr epoch 9 is available 2026-02-13T21:16:42.192 INFO:teuthology.orchestra.run.trial012.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-13T21:16:42.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:42 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:16:42.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:42 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/mirror_snapshot_schedule"} : dispatch 2026-02-13T21:16:42.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:42 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/trash_purge_schedule"} : dispatch 2026-02-13T21:16:42.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:42 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:42.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:42 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:42.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:42 trial012 ceph-mon[37926]: mgrmap e11: trial012.zqhrrq(active, since 1.00659s) 2026-02-13T21:16:42.733 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUIvuhjUdQy6eVyYDPok/1h40GpEswDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI2MDIxMzIxMTY0MloXDTI5\nMDIxMjIxMTY0MlowFzEVMBMGA1UEAwwMMTAuMjAuMTkzLjEyMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAkkcAv1+rCMFu8rC5Ty8xVriaBNJa4/hZVJml\nTK2Z9bYfCvURIDRgL6gUvryRsorpMVJ6w8ZtiQa0vupLH3FGTco2Hy8zrCzqQV2l\nvA4qMCGMaJm2wDffifWA3+Y81zdr0yO5iIG3J5oVq3+wxUl4gl4P3eYsxpQZnSkR\naS51oQE6ir2c9T4yB/bm68hpD6qFANLkyQCwIEYVkJE/BWm2hSMUYLVU4xhRraeT\nhHdBJep3IZpWsUQKUWk7ftKczg3MUVPlEMA046XoirFUKeS6cnTCy2GSX2g/nSVw\ntzfwHvO13EUVotJ5Py/vTdl0maNa9kejtcUmok8XhEraHGkheAQB6D47QkN5OjLy\nyPPLB1b1Y2JauH5pLd0GIT2OVUZ2CAktlsF6eFlkRyQJEkv83CKhvg2ACxqNICWz\nwpqdMjtmcjiXvx+K/pucCsWoz96O4j2dbxsmAe1Hzs54vrMcZnJYCK/3sTAr4U9o\nXyZNfFirVfxYSev+0p9/Rjkx8Gf+rmk0TAgtxr7SpWoSQ39D2bU2e0Ke2RIWFz4K\nKJb5oebsPC3/VVrat7M8fvmzKyZlQYAEQqnbuCCmhJX30LM2XlT4WmiRqNYWtZdD\nAXmrDkPWtO+/4r7DZOhMErR/kKvDwbiS0KhDWcLMHQioQox32GKZqbN4HKNcuL1M\nlfh+9LcCAwEAAaM+MDwwLAYDVR0RBCUwI4IIdHJpYWwwMTKCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwQKFMEMMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAGJE\n9KIQPyeSECfrjrXFVTYQiREpaFO1OQc9QR+UQ15KdrbnBMqo7Pd30DbmBiijYtrp\nQ928uvOpnELnu5/5GW8UcgT0tYxht5P0HskMsSvfWT3ONj3JTAKvMLOJjkLQQ1+X\n47VvLzYw41NaufK+Cj/92s48FUslxKfsM0lud25fUQQqUa5cqjK9Xp5yjOxYVVOp\n1QY1aoLhE4cxhxRGNGU1Au1NH3G9d3IJQwMKHYvQ0CiwgSWg8IGrPc7SLYj/ynC1\nYYXr+NPPBKLy7nce/BYTDT+sMCW/LhzZj6yCsPAFmVQTQ9tF69hIvtlwqtGd94Dj\n09QmLWWjGJ4cTN6iUHeBOyzhfKJhYXzKGgq3wNLEpWgt5ljbzX/TF5GePPnxx8Y2\nTHpwEXy7RmwkCZUDgasG3Ht0s3v6VjBMXuqS/eVHP7eWEG0lxAwTcBiuG32rh2UN\nmNaSAI1AAxJFA0FxsPsRdqSZWm1WrmjIw2yz5ZLWfTH3JB5A4RelYEgf1CWMRt3V\n2gzUo7veOGZq9LhQKqPIpkq2SQkjCnVqu1Y2r8TLJsWc6Fy2OikWIcS4ZxS02S8k\nWSWZkJ8Pt7JW9bFchwiTUv5petr+0QGA7avwZrpy1byBooKjDfuVM8hHhly1w3K3\nO0u0UDChUDDjFymvUX5tyMT2LBeNHltvG2jtvCRZ\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAkkcAv1+rCMFu8rC5Ty8xVriaBNJa4/hZVJmlTK2Z9bYfCvUR\nIDRgL6gUvryRsorpMVJ6w8ZtiQa0vupLH3FGTco2Hy8zrCzqQV2lvA4qMCGMaJm2\nwDffifWA3+Y81zdr0yO5iIG3J5oVq3+wxUl4gl4P3eYsxpQZnSkRaS51oQE6ir2c\n9T4yB/bm68hpD6qFANLkyQCwIEYVkJE/BWm2hSMUYLVU4xhRraeThHdBJep3IZpW\nsUQKUWk7ftKczg3MUVPlEMA046XoirFUKeS6cnTCy2GSX2g/nSVwtzfwHvO13EUV\notJ5Py/vTdl0maNa9kejtcUmok8XhEraHGkheAQB6D47QkN5OjLyyPPLB1b1Y2Ja\nuH5pLd0GIT2OVUZ2CAktlsF6eFlkRyQJEkv83CKhvg2ACxqNICWzwpqdMjtmcjiX\nvx+K/pucCsWoz96O4j2dbxsmAe1Hzs54vrMcZnJYCK/3sTAr4U9oXyZNfFirVfxY\nSev+0p9/Rjkx8Gf+rmk0TAgtxr7SpWoSQ39D2bU2e0Ke2RIWFz4KKJb5oebsPC3/\nVVrat7M8fvmzKyZlQYAEQqnbuCCmhJX30LM2XlT4WmiRqNYWtZdDAXmrDkPWtO+/\n4r7DZOhMErR/kKvDwbiS0KhDWcLMHQioQox32GKZqbN4HKNcuL1Mlfh+9LcCAwEA\nAQKCAgAmCQJfwK+Hcky4HE3DEkFhDFU4Jb5ugrgvsFf0DTv4USfXQIv4dMYB/lGO\nmxfDdi1Wnty/JUx8EdtTvTZVca3XMlpKV4q3HWK4JnKe6Iv9wetxk26aoqykgcrF\n7WcqiwWlfCeVIC2QxZcW5fgABK+qLm0vxNclt4LFg9U8JVF+0QP46X7zof1+Zqv6\n6TywTyWQZkYJIf2qFq8qzSm27ZsBGXMGBoCRIFS0s9s+2Yd+JW5etXQPWeLY8mT/\nACK3zYywJQFuDpxyCUTjM2LwFcKJWmUAX1mhJ0lLQl4BtjDgy3whT3Flyhau4Hb4\nJjAUdw6C9XPTIvV9xNUXmCMIuilyV8CZLD10DZz7C5pmjjQjSiCkV+473k3jXqKe\nE45qrlF08KVmJUTSFimUwZGtcNl1yGSPadbqYxnyL9IofjsSvcDlghL7Vo2zAXaj\nRaZnrt/slN4cmVBWHUuUbbLtsmG0Tefw7WxOtMTVIOU9d9NDIyZUTxQdPjGA8EEs\nv5cU0bm7DULWdVVPL03bETCdLIxhvansAGrKazknnH1rgJbOuP35kG1+SLUy0pOS\na0EUr2xWvk5FSIt740HHth3/VcyyN8dcRN6K/ogjZDXJ5GsU6yT+WHP3G2DJA++C\nIUH0X+PCdJatcQBrBdz8lXxGe4d02phjYIB4sQXOdFDZakb9EQKCAQEAzUp9I9Fr\nHgPJGCVFHhqa4P9sCNUCk0X2OxDBbKqtxOoKZwASo85fhGHJ+/PMBwr5BEIY9QEn\nUUTGUyiM/Q4IK0PMGPcsMstr082JEfD2G8pKvSCwwSw/6w/vgKtQVyfcPsxfh+bB\nMq/p1FmvAELVyctVVBxz7pFjFZ4MKBi3zd1HCeNOR1luoXcwUCjTlsWeGO35DJ1K\nbp8eAF6I/d5fkgTtAxARynCZoqZisqhAXF8FE0wrN0rFz9kyk2oRFyHEkKCgPI+Q\ndlBw4s3ivme1ywxspx/btrMMsFSjOGRyThCYFAYNobTvIklGKPOsGqadWnddNM2U\nrsz3cACdpNtGbwKCAQEAtmjOZ6pMRsdCjlHgbMamUuYrnqXJcJZADW4pBqXRWRLr\neDrIvn1XYusKM5GhoPmKCXEmLccZmNCSR+UlHWSbEMlpKYzAwCz9UXqjtXc0Eos2\nsw7UzcknQF8OK5Nc4h2xArQS9IUmedkjbQVO+0LlUPmUQ1Xs4TgHRTmPQ3EY3Lt+\nbqBFCGplp+Ueb2kEv+TJqdaz1yvsYRnw8FGQJ5sr+yXqQUHgoyfMvGD5whmnvFp6\n8GRU8BGEtvXtSPgOeznAUqSctYr31YUC6m5UCydSyjbEpiaue7HBpsAThR5DjJ0H\neeYSGCZeon5yL3KMgKkZeHRK45cWxIbem/NTZEsaOQKCAQBAQxgHNU/ltmOlpk0L\njmJ7GhmUbjF/LoBUnvsdbBQ3NtgIxBIRqtFlnELhFsEAV2P5/ELZtwG6w9+dOm1f\n7ZuLB48FJaJ1SA453/YPYrF3o4xfxbLu1U4w4+0iBv6AOd8M3WbuIMLLfhuhOG26\nlDFeGMNeMAXuYR52LuI5TvuCesj5BGmFli42Zxv9i7ooUTYbMasrUrVxCWgXz3/s\nkEa0a8xRkB8xkqvVKWZt7JMxFyF8l/RTO5nOZXwafzJYXl6ss0tVic876hRcOvzG\ng6p5pCsC6csaVtQbAnORfIf3feRNKFPuEbhlsDBBM33lXdCV+BV6KPxo94phSiAO\n8gELAoIBAFUSWjlE1mAoLGU90GJK32VITc2m2mT03hilaOLd0N4vEby4Bcm5oVjT\n76UPZYcy+mre54RwGAMKOz7mosGrmxpgJPio2XiHQvmOLe3DE3kWjkNCRoNXLkQ6\nUNyH1MjsOhLdsv1xX/lyCLCeyjArCdITJE+nMlvzioiBiMxWYdcIZrXnb2q2XITK\nOcCSBRIN/POF28gdhxfeRl1+XLHsD74I99DJjZ/qPvUYcUNSPcV9mVqmIGr6cJ/3\n4FuovPBBhe3FMgUFNALUDwEQxYeSJm2Cz4ICBlxQEdXYPQJXk/9veP4kDApRUs+M\nE2sHjHmw490mt4qfe5HaqNWozRq4YBkCggEARUAv5UXSYRqWUq9+lnzVQ4FoOf0z\nYme7y5O9Czk4YFmeFhXOWxIC1VpFIBDw1akSiJitRXOb7cVR6d70WvpX+kUC9Vbl\nSzh3ZwzwsrJAWxBHhtAtanNEDpfYtktnpbKLfIkK1Jfk3Qy9igPT9cy4KgKK/jHI\ncrYMKSRr2YSjpFmh1EFFsx1STo6UPIT41ju/yF8b0yXH+RgpxFrtMR2o2y4lhNDT\nnJFG2Dpi5Bm3A7vUVcBCvDrjvmOpTxlyvkjfWU4BRZIuDpkhMAPJnxZy7Y3XPDqM\nvWM55vg/0TcCdKIijKQ2zejobq3fMiB6OQSMcQbm768e5M2OwdFukzfAhg==\n-----END RSA PRIVATE KEY-----\n"} 2026-02-13T21:16:42.989 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-13T21:16:43.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:43 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:41] ENGINE Bus STARTING 2026-02-13T21:16:43.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:43 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:41] ENGINE Serving on https://10.20.193.12:7150 2026-02-13T21:16:43.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:43 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:41] ENGINE Client ('10.20.193.12', 50530) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-13T21:16:43.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:43 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:42] ENGINE Serving on http://10.20.193.12:8765 2026-02-13T21:16:43.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:43 trial012 ceph-mon[37926]: [13/Feb/2026:21:16:42] ENGINE Bus STARTED 2026-02-13T21:16:43.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:43 trial012 ceph-mon[37926]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T21:16:43.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:43 trial012 ceph-mon[37926]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T21:16:43.225 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:43 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:43.237 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-13T21:16:43.237 INFO:teuthology.orchestra.run.trial012.stdout:Creating initial admin user... 2026-02-13T21:16:43.682 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$K1NX7kzib.q2/Js31CcD5.J7uuHYibEJr8I5J4LC0aFuPtdRfjPNy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771017403, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-13T21:16:43.682 INFO:teuthology.orchestra.run.trial012.stdout:Fetching dashboard port number... 2026-02-13T21:16:43.926 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stdout 8443 2026-02-13T21:16:43.934 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T21:16:43.934 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout disabled 2026-02-13T21:16:43.940 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T21:16:43.940 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout inactive 2026-02-13T21:16:43.940 INFO:teuthology.orchestra.run.trial012.stdout:firewalld.service is not enabled 2026-02-13T21:16:43.940 INFO:teuthology.orchestra.run.trial012.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-13T21:16:43.941 INFO:teuthology.orchestra.run.trial012.stdout:Ceph Dashboard is now available at: 2026-02-13T21:16:43.941 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:43.941 INFO:teuthology.orchestra.run.trial012.stdout: URL: https://trial012:8443/ 2026-02-13T21:16:43.941 INFO:teuthology.orchestra.run.trial012.stdout: User: admin 2026-02-13T21:16:43.941 INFO:teuthology.orchestra.run.trial012.stdout: Password: 4wbgcwl8e0 2026-02-13T21:16:43.941 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:43.941 INFO:teuthology.orchestra.run.trial012.stdout:Saving cluster configuration to /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config directory 2026-02-13T21:16:44.244 INFO:teuthology.orchestra.run.trial012.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T21:16:44.244 INFO:teuthology.orchestra.run.trial012.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: ceph telemetry on 2026-02-13T21:16:44.245 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:44.246 INFO:teuthology.orchestra.run.trial012.stdout:For more information see: 2026-02-13T21:16:44.246 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:44.246 INFO:teuthology.orchestra.run.trial012.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T21:16:44.246 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:44.246 INFO:teuthology.orchestra.run.trial012.stdout:Bootstrap complete. 2026-02-13T21:16:44.252 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout static 2026-02-13T21:16:44.258 INFO:teuthology.orchestra.run.trial012.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T21:16:44.258 INFO:teuthology.orchestra.run.trial012.stdout:systemctl: stdout inactive 2026-02-13T21:16:44.258 INFO:teuthology.orchestra.run.trial012.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T21:16:44.401 INFO:tasks.cephadm:Fetching config... 2026-02-13T21:16:44.401 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:44.401 DEBUG:teuthology.orchestra.run.trial012:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T21:16:44.418 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T21:16:44.419 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:44.419 DEBUG:teuthology.orchestra.run.trial012:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T21:16:44.447 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:44 trial012 ceph-mon[37926]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:44.447 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:44 trial012 ceph-mon[37926]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:44.447 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:44 trial012 ceph-mon[37926]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:44.447 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:44 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:44.447 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:44 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:44.447 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:44 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/549674316' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-13T21:16:44.447 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:44 trial012 ceph-mon[37926]: mgrmap e12: trial012.zqhrrq(active, since 2s) 2026-02-13T21:16:44.462 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T21:16:44.462 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:44.462 DEBUG:teuthology.orchestra.run.trial012:> sudo dd if=/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/keyring of=/dev/stdout 2026-02-13T21:16:44.531 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T21:16:44.531 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:16:44.531 DEBUG:teuthology.orchestra.run.trial012:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T21:16:44.588 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T21:16:44.588 DEBUG:teuthology.orchestra.run.trial012:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII8G4NwWg1ZdBzd6R/8qhenN3gjtHuhmTlLJugyTUFMc ceph-3551db35-0921-11f1-800a-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T21:16:44.660 INFO:teuthology.orchestra.run.trial012.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII8G4NwWg1ZdBzd6R/8qhenN3gjtHuhmTlLJugyTUFMc ceph-3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:44.670 DEBUG:teuthology.orchestra.run.trial090:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII8G4NwWg1ZdBzd6R/8qhenN3gjtHuhmTlLJugyTUFMc ceph-3551db35-0921-11f1-800a-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T21:16:44.705 INFO:teuthology.orchestra.run.trial090.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII8G4NwWg1ZdBzd6R/8qhenN3gjtHuhmTlLJugyTUFMc ceph-3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:16:44.716 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T21:16:44.831 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:16:45.112 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T21:16:45.112 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T21:16:45.230 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:16:45.252 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:45 trial012 ceph-mon[37926]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:45.253 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:45 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3819855884' entity='client.admin' 2026-02-13T21:16:45.253 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:45 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3756497052' entity='client.admin' 2026-02-13T21:16:45.511 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial090 2026-02-13T21:16:45.511 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:16:45.511 DEBUG:teuthology.orchestra.run.trial090:> dd of=/etc/ceph/ceph.conf 2026-02-13T21:16:45.530 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:16:45.530 DEBUG:teuthology.orchestra.run.trial090:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T21:16:45.585 INFO:tasks.cephadm:Adding host trial090 to orchestrator... 2026-02-13T21:16:45.585 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch host add trial090 2026-02-13T21:16:45.702 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:16:46.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:46.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:46.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd/host:trial012", "name": "osd_memory_target"} : dispatch 2026-02-13T21:16:46.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:46.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial012", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2026-02-13T21:16:46.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial012", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: Deploying daemon ceph-exporter.trial012 on trial012 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial090", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.trial012", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial012", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:16:46.659 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: Deploying daemon crash.trial012 on trial012 2026-02-13T21:16:46.660 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: Deploying cephadm binary to trial090 2026-02-13T21:16:46.660 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:46 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:47.583 INFO:teuthology.orchestra.run.trial012.stdout:Added host 'trial090' with addr '10.20.193.90' 2026-02-13T21:16:47.698 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T21:16:47.819 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:16:48.053 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:16:48.054 INFO:teuthology.orchestra.run.trial012.stdout:[{"addr": "10.20.193.12", "hostname": "trial012", "labels": [], "status": ""}, {"addr": "10.20.193.90", "hostname": "trial090", "labels": [], "status": ""}] 2026-02-13T21:16:48.091 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T21:16:48.091 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T21:16:48.210 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:16:48.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:48 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:48.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:48 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:48.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:48 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:48.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:48 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:48.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:48 trial012 ceph-mon[37926]: Deploying daemon node-exporter.trial012 on trial012 2026-02-13T21:16:48.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:48 trial012 ceph-mon[37926]: mgrmap e13: trial012.zqhrrq(active, since 6s) 2026-02-13T21:16:48.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:48 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:49.233 INFO:teuthology.orchestra.run.trial012.stderr:adjusted tunables profile to default 2026-02-13T21:16:49.290 INFO:tasks.cephadm:Adding mon.trial012 on trial012 2026-02-13T21:16:49.290 INFO:tasks.cephadm:Adding mon.trial090 on trial090 2026-02-13T21:16:49.291 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch apply mon '2;trial012:10.20.193.12=trial012;trial090:10.20.193.90=trial090' 2026-02-13T21:16:49.412 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:49.413 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:49.485 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:49 trial012 ceph-mon[37926]: Added host trial090 2026-02-13T21:16:49.486 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:49 trial012 ceph-mon[37926]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T21:16:49.486 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:49 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2862261470' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T21:16:49.486 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:49 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:49.486 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:49 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:49.486 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:49 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:49.486 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:49 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:49.658 INFO:teuthology.orchestra.run.trial090.stdout:Scheduled mon update... 2026-02-13T21:16:49.697 DEBUG:teuthology.orchestra.run.trial090:mon.trial090> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial090.service 2026-02-13T21:16:49.699 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:16:49.700 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:16:49.883 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:49.884 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:50.163 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:16:50.163 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:16:50.164 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:16:50.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: Deploying daemon alertmanager.trial012 on trial012 2026-02-13T21:16:50.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2862261470' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T21:16:50.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T21:16:50.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:50.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:50.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:50.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:50.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:50.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:50 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/507190449' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:16:51.213 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:16:51.213 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:16:51.335 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:51.335 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:51.607 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:16:51.607 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:16:51.607 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;trial012:10.20.193.12=trial012;trial090:10.20.193.90=trial090", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: Saving service mon spec with placement trial012:10.20.193.12=trial012;trial090:10.20.193.90=trial090;count:2 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: Generating cephadm-signed certificates for grafana_cert/grafana_key 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2026-02-13T21:16:51.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:51 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:52.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:52 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-13T21:16:52.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:52 trial012 ceph-mon[37926]: Deploying daemon grafana.trial012 on trial012 2026-02-13T21:16:52.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:52 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:52.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:52 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/1269318778' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:16:52.645 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:16:52.645 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:16:52.762 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:52.763 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:53.034 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:16:53.035 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:16:53.035 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:16:53.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:53 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/3425939197' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:16:54.072 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:16:54.072 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:16:54.189 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:54.190 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:54.454 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:16:54.454 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:16:54.455 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:16:54.762 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:54 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/904854064' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:16:55.492 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:16:55.492 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:16:55.610 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:55.611 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:55.882 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:16:55.883 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:16:55.883 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:16:56.358 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:56.358 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:56.358 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:56.358 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:56.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:56.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:56.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:56.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:56.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: Deploying daemon prometheus.trial012 on trial012 2026-02-13T21:16:56.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:56 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/2919164351' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:16:56.921 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:16:56.922 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:16:57.040 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:57.040 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:57.311 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:16:57.311 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:16:57.312 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:16:57.514 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:57 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:57.514 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:57 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/3610655129' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:16:58.349 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:16:58.350 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:16:58.467 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:58.467 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:58.736 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:16:58.737 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:16:58.737 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:16:59.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:58 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:59.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:58 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:59.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:58 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:16:59.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:58 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2026-02-13T21:16:59.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:58 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/94414480' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:16:59.774 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:16:59.775 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:16:59.894 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:16:59.895 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:17:00.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:59 trial012 ceph-mon[37926]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-13T21:17:00.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:16:59 trial012 ceph-mon[37926]: mgrmap e14: trial012.zqhrrq(active, since 17s) 2026-02-13T21:17:00.161 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:00.162 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:17:00.162 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:17:01.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:00 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/193302292' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:01.199 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:17:01.200 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:17:01.318 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:17:01.318 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:17:01.587 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:01.587 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:17:01.588 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:17:02.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/461507570' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:02.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: Active manager daemon trial012.zqhrrq restarted 2026-02-13T21:17:02.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: Activating manager daemon trial012.zqhrrq 2026-02-13T21:17:02.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: osdmap e5: 0 total, 0 up, 0 in 2026-02-13T21:17:02.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: mgrmap e15: trial012.zqhrrq(active, starting, since 0.00329343s) 2026-02-13T21:17:02.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:02.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial012.zqhrrq", "id": "trial012.zqhrrq"} : dispatch 2026-02-13T21:17:02.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T21:17:02.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T21:17:02.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T21:17:02.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: Manager daemon trial012.zqhrrq is now available 2026-02-13T21:17:02.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:02.628 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:17:02.628 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:17:02.749 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:17:02.749 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T21:17:03.029 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:03.030 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:17:03.030 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:17:03.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:03.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:17:03.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:03.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/mirror_snapshot_schedule"} : dispatch 2026-02-13T21:17:03.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/trash_purge_schedule"} : dispatch 2026-02-13T21:17:03.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:03.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:03.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: mgrmap e16: trial012.zqhrrq(active, since 1.00556s) 2026-02-13T21:17:03.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:03.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:03.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:04.070 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:17:04.070 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:17:04.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: [13/Feb/2026:21:17:02] ENGINE Bus STARTING 2026-02-13T21:17:04.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: [13/Feb/2026:21:17:02] ENGINE Serving on http://10.20.193.12:8765 2026-02-13T21:17:04.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:04.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: [13/Feb/2026:21:17:02] ENGINE Serving on https://10.20.193.12:7150 2026-02-13T21:17:04.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: [13/Feb/2026:21:17:02] ENGINE Bus STARTED 2026-02-13T21:17:04.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: [13/Feb/2026:21:17:02] ENGINE Client ('10.20.193.12', 45950) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-13T21:17:04.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/2208495476' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:04.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd/host:trial012", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:04.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:03 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:04.194 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:04.477 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:04.477 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:17:04.477 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Updating trial012:/etc/ceph/ceph.conf 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Updating trial090:/etc/ceph/ceph.conf 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Updating trial012:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Updating trial090:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Updating trial012:/etc/ceph/ceph.client.admin.keyring 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Updating trial090:/etc/ceph/ceph.client.admin.keyring 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Updating trial012:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Updating trial090:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-13T21:17:05.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial090", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial090", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: Deploying daemon ceph-exporter.trial090 on trial090 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: mgrmap e17: trial012.zqhrrq(active, since 2s) 2026-02-13T21:17:05.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:04 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/1900159596' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:05.556 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:17:05.556 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:17:05.676 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:05.945 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:05.945 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:17:05.945 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.trial090", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial090", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: Deploying daemon crash.trial090 on trial090 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: Deploying daemon node-exporter.trial090 on trial090 2026-02-13T21:17:06.359 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:06 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/3040070409' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:07.076 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:17:07.077 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:17:07.196 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:07.472 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:07.472 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:16:18.809061Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-13T21:17:07.472 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mgr.trial090.qsdrej", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.trial090.qsdrej", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T21:17:08.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/2337466212' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T21:17:08.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.486 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 podman[42847]: 2026-02-13 21:17:08.459558767 +0000 UTC m=+0.015750121 container create 2e254abd16b2664bd80f1fa308498372c00221fcd6448a5cb3476cc3b3587d65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial090, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, ceph=True, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-13T21:17:08.554 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-13T21:17:08.555 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T21:17:08.676 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:17:08.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 podman[42847]: 2026-02-13 21:17:08.487658081 +0000 UTC m=+0.043849445 container init 2e254abd16b2664bd80f1fa308498372c00221fcd6448a5cb3476cc3b3587d65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial090, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260209, ceph=True, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T21:17:08.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 podman[42847]: 2026-02-13 21:17:08.489997215 +0000 UTC m=+0.046188579 container start 2e254abd16b2664bd80f1fa308498372c00221fcd6448a5cb3476cc3b3587d65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial090, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260209, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T21:17:08.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 bash[42847]: 2e254abd16b2664bd80f1fa308498372c00221fcd6448a5cb3476cc3b3587d65 2026-02-13T21:17:08.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 podman[42847]: 2026-02-13 21:17:08.453396082 +0000 UTC m=+0.009587446 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 systemd[1]: Started Ceph mon.trial090 for 3551db35-0921-11f1-800a-d404e6e7d460. 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: ceph version 20.2.0-690-g3baf6bae (3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) tentacle (stable - Debug), process ceph-mon, pid 2 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: pidfile_write: ignore empty --pid-file 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: load: jerasure load: lrc 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: RocksDB version: 7.9.2 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Git sha 0 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Compile date 2026-02-13 20:26:06 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: DB SUMMARY 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: DB Session ID: DA6258AHEY5XQDEA8Z9O 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: CURRENT file: CURRENT 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-02-13T21:17:08.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: SST files in /var/lib/ceph/mon/ceph-trial090/store.db dir, Total Num: 0, files: 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-trial090/store.db: 000004.log size: 511 ; 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.error_if_exists: 0 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.create_if_missing: 0 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.paranoid_checks: 1 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.env: 0x5632ec489100 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.info_log: 0x5632f1755d60 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.statistics: (nil) 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.use_fsync: 0 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_log_file_size: 0 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T21:17:08.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.allow_fallocate: 1 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.use_direct_reads: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.db_log_dir: 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.wal_dir: 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T21:17:08.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.write_buffer_manager: 0x5632f1758500 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.unordered_write: 0 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T21:17:08.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.row_cache: None 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.wal_filter: None 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.two_write_queues: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.wal_compression: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.atomic_flush: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.log_readahead_size: 0 2026-02-13T21:17:08.778 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_background_jobs: 2 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_background_compactions: -1 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_subcompactions: 1 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T21:17:08.779 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_open_files: -1 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_background_flushes: -1 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Compression algorithms supported: 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: kZSTD supported: 0 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: kXpressCompression supported: 0 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: kBZip2Compression supported: 0 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: kLZ4Compression supported: 1 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: kZlibCompression supported: 1 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: kSnappyCompression supported: 1 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T21:17:08.780 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-trial090/store.db/MANIFEST-000005 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.merge_operator: 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_filter: None 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5632f1754520) 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: cache_index_and_filter_blocks: 1 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: pin_top_level_index_and_filter: 1 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: index_type: 0 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: data_block_index_type: 0 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: index_shortening: 1 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T21:17:08.781 INFO:journalctl@ceph.mon.trial090.trial090.stdout: checksum: 4 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: no_block_cache: 0 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: block_cache: 0x5632f1775b90 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: block_cache_name: BinnedLRUCache 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: block_cache_options: 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: capacity : 536870912 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: num_shard_bits : 4 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: strict_capacity_limit : 0 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: high_pri_pool_ratio: 0.000 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: block_cache_compressed: (nil) 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: persistent_cache: (nil) 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: block_size: 4096 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: block_size_deviation: 10 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: block_restart_interval: 16 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: index_block_restart_interval: 1 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: metadata_block_size: 4096 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: partition_filters: 0 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: use_delta_encoding: 1 2026-02-13T21:17:08.782 INFO:journalctl@ceph.mon.trial090.trial090.stdout: filter_policy: bloomfilter 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: whole_key_filtering: 1 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: verify_compression: 0 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: read_amp_bytes_per_bit: 0 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: format_version: 5 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: enable_index_compression: 1 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: block_align: 0 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: max_auto_readahead_size: 262144 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: prepopulate_block_cache: 0 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: initial_auto_readahead_size: 8192 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression: NoCompression 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.num_levels: 7 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T21:17:08.783 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T21:17:08.784 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T21:17:08.785 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.inplace_update_support: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.bloom_locality: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.max_successive_merges: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T21:17:08.786 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.ttl: 2592000 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.enable_blob_files: false 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.min_blob_size: 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-trial090/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 21ed5b78-6de9-416b-9c60-b486eff1399e 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771017428519510, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-02-13T21:17:08.787 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771017428519883, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1647, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771017428, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "21ed5b78-6de9-416b-9c60-b486eff1399e", "db_session_id": "DA6258AHEY5XQDEA8Z9O", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771017428519938, "job": 1, "event": "recovery_finished"} 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-trial090/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5632f1778700 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: DB pointer 0x5632f178a000 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: ** DB Stats ** 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: ** Compaction Stats [default] ** 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T21:17:08.788 INFO:journalctl@ceph.mon.trial090.trial090.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: ** Compaction Stats [default] ** 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Interval compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T21:17:08.789 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Block cache BinnedLRUCache@0x5632f1775b90#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.2e-05 secs_since: 0 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090 does not exist in monmap, will attempt to join an existing cluster 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: using public_addr v2:10.20.193.90:0/0 -> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: starting mon.trial090 rank -1 at public addrs [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] at bind addrs [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon_data /var/lib/ceph/mon/ceph-trial090 fsid 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(???) e0 preinit fsid 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).mds e1 new map 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).mds e1 print_map 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: e1 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: btime 2026-02-13T21:16:19:758535+0000 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: legacy client fscid: -1 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout: No filesystems configured 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-02-13T21:17:08.790 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mkfs 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial012 is new leader, mons trial012 in quorum (ranks 0) 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial012 is new leader, mons trial012 in quorum (ranks 0) 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: monmap epoch 1 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: fsid 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: last_changed 2026-02-13T21:16:18.809061+0000 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: created 2026-02-13T21:16:18.809061+0000 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: min_mon_release 20 (tentacle) 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: election_strategy: 1 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: 0: [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] mon.trial012 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: fsmap 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e1: no daemons active 2026-02-13T21:17:08.791 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2719141451' entity='client.admin' 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/467489501' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2730412610' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Activating manager daemon trial012.zqhrrq 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e2: trial012.zqhrrq(active, starting, since 0.00343732s) 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial012.zqhrrq", "id": "trial012.zqhrrq"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Manager daemon trial012.zqhrrq is now available 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/mirror_snapshot_schedule"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/trash_purge_schedule"} : dispatch 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14100 10.20.193.12:0/3552481646' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.792 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e3: trial012.zqhrrq(active, since 1.00586s) 2026-02-13T21:17:08.793 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/4215469502' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T21:17:08.793 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e4: trial012.zqhrrq(active, since 2s) 2026-02-13T21:17:08.793 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3810687908' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T21:17:08.793 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3148838787' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T21:17:08.793 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3148838787' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T21:17:08.793 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e5: trial012.zqhrrq(active, since 3s) 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/4164652635' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Active manager daemon trial012.zqhrrq restarted 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Activating manager daemon trial012.zqhrrq 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e6: trial012.zqhrrq(active, starting, since 0.00319584s) 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial012.zqhrrq", "id": "trial012.zqhrrq"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Manager daemon trial012.zqhrrq is now available 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Found migration_current of "None". Setting to last migration. 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/mirror_snapshot_schedule"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/trash_purge_schedule"} : dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e7: trial012.zqhrrq(active, since 1.00462s) 2026-02-13T21:17:08.794 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2726871551' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:31] ENGINE Bus STARTING 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:31] ENGINE Serving on https://10.20.193.12:7150 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:31] ENGINE Client ('10.20.193.12', 45142) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:31] ENGINE Serving on http://10.20.193.12:8765 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:31] ENGINE Bus STARTED 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2726871551' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e8: trial012.zqhrrq(active, since 2s) 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Generating ssh key... 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial012", "addr": "10.20.193.12", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying cephadm binary to trial012 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Added host trial012 2026-02-13T21:17:08.795 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service mon spec with placement count:5 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service mgr spec with placement count:2 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service crash spec with placement * 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service ceph-exporter spec with placement * 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service prometheus spec with placement count:1 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14118 10.20.193.12:0/567784747' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service grafana spec with placement count:1 2026-02-13T21:17:08.796 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service node-exporter spec with placement * 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service alertmanager spec with placement count:1 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3030499417' entity='client.admin' 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1026232998' entity='client.admin' 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1147694329' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1147694329' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e9: trial012.zqhrrq(active, since 8s) 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1379723789' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Active manager daemon trial012.zqhrrq restarted 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Activating manager daemon trial012.zqhrrq 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e10: trial012.zqhrrq(active, starting, since 0.00304784s) 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial012.zqhrrq", "id": "trial012.zqhrrq"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Manager daemon trial012.zqhrrq is now available 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/mirror_snapshot_schedule"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/trash_purge_schedule"} : dispatch 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e11: trial012.zqhrrq(active, since 1.00659s) 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:41] ENGINE Bus STARTING 2026-02-13T21:17:08.797 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:41] ENGINE Serving on https://10.20.193.12:7150 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:41] ENGINE Client ('10.20.193.12', 50530) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:42] ENGINE Serving on http://10.20.193.12:8765 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:16:42] ENGINE Bus STARTED 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/549674316' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e12: trial012.zqhrrq(active, since 2s) 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3819855884' entity='client.admin' 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3756497052' entity='client.admin' 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd/host:trial012", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial012", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial012", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon ceph-exporter.trial012 on trial012 2026-02-13T21:17:08.798 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial090", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.trial012", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial012", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon crash.trial012 on trial012 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying cephadm binary to trial090 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon node-exporter.trial012 on trial012 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e13: trial012.zqhrrq(active, since 6s) 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Added host trial090 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2862261470' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.799 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon alertmanager.trial012 on trial012 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2862261470' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/507190449' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;trial012:10.20.193.12=trial012;trial090:10.20.193.90=trial090", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Saving service mon spec with placement trial012:10.20.193.12=trial012;trial090:10.20.193.90=trial090;count:2 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Generating cephadm-signed certificates for grafana_cert/grafana_key 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon grafana.trial012 on trial012 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/1269318778' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/3425939197' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/904854064' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.800 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon prometheus.trial012 on trial012 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/2919164351' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/3610655129' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/94414480' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14164 10.20.193.12:0/1105765845' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e14: trial012.zqhrrq(active, since 17s) 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/193302292' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/461507570' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Active manager daemon trial012.zqhrrq restarted 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Activating manager daemon trial012.zqhrrq 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: osdmap e5: 0 total, 0 up, 0 in 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e15: trial012.zqhrrq(active, starting, since 0.00329343s) 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial012.zqhrrq", "id": "trial012.zqhrrq"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T21:17:08.801 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Manager daemon trial012.zqhrrq is now available 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/mirror_snapshot_schedule"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial012.zqhrrq/trash_purge_schedule"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e16: trial012.zqhrrq(active, since 1.00556s) 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:17:02] ENGINE Bus STARTING 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:17:02] ENGINE Serving on http://10.20.193.12:8765 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:17:02] ENGINE Serving on https://10.20.193.12:7150 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:17:02] ENGINE Bus STARTED 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: [13/Feb/2026:21:17:02] ENGINE Client ('10.20.193.12', 45950) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/2208495476' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd/host:trial012", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.802 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Updating trial012:/etc/ceph/ceph.conf 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Updating trial090:/etc/ceph/ceph.conf 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Updating trial012:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Updating trial090:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Updating trial012:/etc/ceph/ceph.client.admin.keyring 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Updating trial090:/etc/ceph/ceph.client.admin.keyring 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Updating trial012:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Updating trial090:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial090", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial090", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon ceph-exporter.trial090 on trial090 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mgrmap e17: trial012.zqhrrq(active, since 2s) 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/1900159596' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.trial090", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial090", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.803 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon crash.trial090 on trial090 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: Deploying daemon node-exporter.trial090 on trial090 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/3040070409' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mgr.trial090.qsdrej", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.trial090.qsdrej", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/2337466212' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:08.804 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:08 trial090 ceph-mon[42877]: mon.trial090@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2026-02-13T21:17:13.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:13.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: mon.trial012 calling monitor election 2026-02-13T21:17:13.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:13.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.? 10.20.193.90:0/608270172' entity='mgr.trial090.qsdrej' cmd={"prefix": "config-key get", "key": "mgr/dashboard/trial090.qsdrej/crt"} : dispatch 2026-02-13T21:17:13.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: mon.trial090 calling monitor election 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: mon.trial012 is new leader, mons trial012,trial090 in quorum (ranks 0,1) 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: monmap epoch 2 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: fsid 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: last_changed 2026-02-13T21:17:08.543532+0000 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: created 2026-02-13T21:16:18.809061+0000 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: min_mon_release 20 (tentacle) 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: election_strategy: 1 2026-02-13T21:17:13.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: 0: [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] mon.trial012 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: 1: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.trial090 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: fsmap 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: osdmap e5: 0 total, 0 up, 0 in 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: mgrmap e17: trial012.zqhrrq(active, since 11s) 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: overall HEALTH_OK 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: Standby manager daemon trial090.qsdrej started 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.? 10.20.193.90:0/608270172' entity='mgr.trial090.qsdrej' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.? 10.20.193.90:0/608270172' entity='mgr.trial090.qsdrej' cmd={"prefix": "config-key get", "key": "mgr/dashboard/trial090.qsdrej/key"} : dispatch 2026-02-13T21:17:13.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:13 trial012 ceph-mon[37926]: from='mgr.? 10.20.193.90:0/608270172' entity='mgr.trial090.qsdrej' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-13T21:17:13.971 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: mon.trial012 calling monitor election 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.? 10.20.193.90:0/608270172' entity='mgr.trial090.qsdrej' cmd={"prefix": "config-key get", "key": "mgr/dashboard/trial090.qsdrej/crt"} : dispatch 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: mon.trial090 calling monitor election 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.972 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: mon.trial012 is new leader, mons trial012,trial090 in quorum (ranks 0,1) 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: monmap epoch 2 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: fsid 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: last_changed 2026-02-13T21:17:08.543532+0000 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: created 2026-02-13T21:16:18.809061+0000 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: min_mon_release 20 (tentacle) 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: election_strategy: 1 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: 0: [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] mon.trial012 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: 1: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.trial090 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: fsmap 2026-02-13T21:17:13.973 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: osdmap e5: 0 total, 0 up, 0 in 2026-02-13T21:17:13.974 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: mgrmap e17: trial012.zqhrrq(active, since 11s) 2026-02-13T21:17:13.974 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: overall HEALTH_OK 2026-02-13T21:17:13.974 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: Standby manager daemon trial090.qsdrej started 2026-02-13T21:17:13.974 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.? 10.20.193.90:0/608270172' entity='mgr.trial090.qsdrej' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-13T21:17:13.974 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:13.974 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.? 10.20.193.90:0/608270172' entity='mgr.trial090.qsdrej' cmd={"prefix": "config-key get", "key": "mgr/dashboard/trial090.qsdrej/key"} : dispatch 2026-02-13T21:17:13.974 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:13 trial090 ceph-mon[42877]: from='mgr.? 10.20.193.90:0/608270172' entity='mgr.trial090.qsdrej' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-13T21:17:14.778 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: mgrmap e18: trial012.zqhrrq(active, since 11s), standbys: trial090.qsdrej 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial090.qsdrej", "id": "trial090.qsdrej"} : dispatch 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.779 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T21:17:14.780 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T21:17:14.780 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:14.780 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:14.780 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.780 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.780 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mgr.trial012.zqhrrq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T21:17:14.780 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T21:17:14.780 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:14.953 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:14.953 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":2,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","modified":"2026-02-13T21:17:08.543532Z","created":"2026-02-13T21:16:18.809061Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"trial012","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:3300","nonce":0},{"type":"v1","addr":"10.20.193.12:6789","nonce":0}]},"addr":"10.20.193.12:6789/0","public_addr":"10.20.193.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"trial090","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:3300","nonce":0},{"type":"v1","addr":"10.20.193.90:6789","nonce":0}]},"addr":"10.20.193.90:6789/0","public_addr":"10.20.193.90:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-02-13T21:17:14.954 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 2 2026-02-13T21:17:14.954 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: mgrmap e18: trial012.zqhrrq(active, since 11s), standbys: trial090.qsdrej 2026-02-13T21:17:14.954 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr metadata", "who": "trial090.qsdrej", "id": "trial090.qsdrej"} : dispatch 2026-02-13T21:17:14.954 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.954 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.954 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:14.955 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.956 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:14.956 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mgr.trial012.zqhrrq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T21:17:14.956 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T21:17:14.956 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:14.991 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T21:17:14.992 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T21:17:15.113 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.352 INFO:teuthology.orchestra.run.trial012.stdout:# minimal ceph.conf for 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:17:15.353 INFO:teuthology.orchestra.run.trial012.stdout:[global] 2026-02-13T21:17:15.353 INFO:teuthology.orchestra.run.trial012.stdout: fsid = 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:17:15.353 INFO:teuthology.orchestra.run.trial012.stdout: mon_host = [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] 2026-02-13T21:17:15.400 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T21:17:15.401 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:17:15.401 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T21:17:15.427 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:17:15.428 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T21:17:15.494 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:17:15.495 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T21:17:15.523 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:17:15.524 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T21:17:15.588 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T21:17:15.588 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T21:17:15.590 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T21:17:15.591 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T21:17:15.633 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T21:17:15.633 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T21:17:15.676 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T21:17:15.676 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T21:17:15.708 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.709 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T21:17:15.710 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T21:17:15.750 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.751 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T21:17:15.751 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T21:17:15.795 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T21:17:15.796 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T21:17:15.828 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.829 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T21:17:15.829 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T21:17:15.841 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.842 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T21:17:15.843 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T21:17:15.856 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Updating trial012:/etc/ceph/ceph.conf 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Updating trial090:/etc/ceph/ceph.conf 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Updating trial090:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Updating trial012:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Reconfiguring mon.trial012 (unknown last config time)... 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Reconfiguring daemon mon.trial012 on trial012 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Reconfiguring mgr.trial012.zqhrrq (unknown last config time)... 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Reconfiguring daemon mgr.trial012.zqhrrq on trial012 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:15.857 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Reconfiguring ceph-exporter.trial012 (monmap changed)... 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial012", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: Reconfiguring daemon ceph-exporter.trial012 on trial012 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/3785029360' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.trial012", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1586759610' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:15.858 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:15.859 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T21:17:15.859 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T21:17:15.884 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.885 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T21:17:15.886 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T21:17:15.929 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T21:17:15.930 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T21:17:15.931 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.932 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T21:17:15.933 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T21:17:15.961 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.963 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T21:17:15.963 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T21:17:15.981 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:15.982 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T21:17:15.983 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T21:17:16.025 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.027 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T21:17:16.027 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T21:17:16.031 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.036 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T21:17:16.037 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T21:17:16.051 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T21:17:16.051 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T21:17:16.094 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T21:17:16.094 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T21:17:16.104 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.104 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.107 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T21:17:16.107 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T21:17:16.120 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.121 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T21:17:16.122 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T21:17:16.151 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.154 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T21:17:16.154 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T21:17:16.177 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.173+0000 7fdbd537c640 1 -- 10.20.193.12:0/1175194810 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdba40795d0 msgr2=0x7fdba4099ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.177 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.173+0000 7fdbd537c640 1 --2- 10.20.193.12:0/1175194810 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdba40795d0 0x7fdba4099ae0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4005fb0 tx=0x7fdbc4004400 comp rx=0 tx=0).stop 2026-02-13T21:17:16.177 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.173+0000 7fdbd537c640 1 -- 10.20.193.12:0/1175194810 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdbd010b700 msgr2=0x7fdbd00f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.177 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.173+0000 7fdbd537c640 1 --2- 10.20.193.12:0/1175194810 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdbd010b700 0x7fdbd00f47e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8005970 tx=0x7fdbb8004290 comp rx=0 tx=0).stop 2026-02-13T21:17:16.179 DEBUG:tasks.cephadm:set 22 configs 2026-02-13T21:17:16.179 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.179 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.179 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.175+0000 7fa391104640 1 -- 10.20.193.12:0/1087856186 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 msgr2=0x7fa3840b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.175+0000 7fa391104640 1 --2- 10.20.193.12:0/1087856186 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 0x7fa3840b42a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009840 tx=0x7fa37c02f120 comp rx=0 tx=0).stop 2026-02-13T21:17:16.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.176+0000 7fa391104640 1 -- 10.20.193.12:0/1087856186 shutdown_connections 2026-02-13T21:17:16.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.176+0000 7fa391104640 1 --2- 10.20.193.12:0/1087856186 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 0x7fa3840b42a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.176+0000 7fa391104640 1 --2- 10.20.193.12:0/1087856186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3840b2d60 0x7fa3840b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.176+0000 7fa391104640 1 -- 10.20.193.12:0/1087856186 >> 10.20.193.12:0/1087856186 conn(0x7fa384090400 msgr2=0x7fa3840b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.176+0000 7fa391104640 1 -- 10.20.193.12:0/1087856186 shutdown_connections 2026-02-13T21:17:16.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.176+0000 7fa391104640 1 -- 10.20.193.12:0/1087856186 wait complete. 2026-02-13T21:17:16.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.177+0000 7fa391104640 1 Processor -- start 2026-02-13T21:17:16.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.177+0000 7fa391104640 1 -- start start 2026-02-13T21:17:16.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fa391104640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3840b2d60 0x7fa38409c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fa391104640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 0x7fa38409ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fdbd537c640 1 -- 10.20.193.12:0/1175194810 shutdown_connections 2026-02-13T21:17:16.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fdbd537c640 1 --2- 10.20.193.12:0/1175194810 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdba40795d0 0x7fdba4099ae0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fdbd537c640 1 --2- 10.20.193.12:0/1175194810 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdbd010b700 0x7fdbd00f47e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fdbd537c640 1 --2- 10.20.193.12:0/1175194810 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdbd010a5d0 0x7fdbd00f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.183 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fdbd537c640 1 -- 10.20.193.12:0/1175194810 >> 10.20.193.12:0/1175194810 conn(0x7fdbd00e7c90 msgr2=0x7fdbd00ea450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.183 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fa391104640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3840f7a50 con 0x7fa3840b3e90 2026-02-13T21:17:16.183 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fa391104640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3840f78d0 con 0x7fa3840b2d60 2026-02-13T21:17:16.183 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fa38b7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 0x7fa38409ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.183 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fa38b7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 0x7fa38409ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52008/0 (socket says 10.20.193.12:52008) 2026-02-13T21:17:16.184 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.178+0000 7fa38b7fe640 1 -- 10.20.193.12:0/2938480853 learned_addr learned my addr 10.20.193.12:0/2938480853 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.184 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.179+0000 7fa38b7fe640 1 -- 10.20.193.12:0/2938480853 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3840b2d60 msgr2=0x7fa38409c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.184 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.179+0000 7fa38b7fe640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3840b2d60 0x7fa38409c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.184 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.179+0000 7fa38b7fe640 1 -- 10.20.193.12:0/2938480853 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38409d9e0 con 0x7fa3840b3e90 2026-02-13T21:17:16.184 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.179+0000 7fa38b7fe640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 0x7fa38409ce90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa37c004790 tx=0x7fa37c005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.184 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.179+0000 7fa3897fa640 1 -- 10.20.193.12:0/2938480853 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa37c048070 con 0x7fa3840b3e90 2026-02-13T21:17:16.185 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.180+0000 7fa3897fa640 1 -- 10.20.193.12:0/2938480853 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa37c004490 con 0x7fa3840b3e90 2026-02-13T21:17:16.185 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.180+0000 7fa3897fa640 1 -- 10.20.193.12:0/2938480853 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa37c043970 con 0x7fa3840b3e90 2026-02-13T21:17:16.185 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.180+0000 7fa391104640 1 -- 10.20.193.12:0/2938480853 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38409dc70 con 0x7fa3840b3e90 2026-02-13T21:17:16.185 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.180+0000 7fa391104640 1 -- 10.20.193.12:0/2938480853 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38409e1a0 con 0x7fa3840b3e90 2026-02-13T21:17:16.185 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.182+0000 7fdbd537c640 1 -- 10.20.193.12:0/1175194810 shutdown_connections 2026-02-13T21:17:16.185 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.182+0000 7fdbd537c640 1 -- 10.20.193.12:0/1175194810 wait complete. 2026-02-13T21:17:16.186 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.182+0000 7fa35effd640 1 -- 10.20.193.12:0/2938480853 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa354005390 con 0x7fa3840b3e90 2026-02-13T21:17:16.186 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.183+0000 7fa3897fa640 1 -- 10.20.193.12:0/2938480853 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7fa37c03a700 con 0x7fa3840b3e90 2026-02-13T21:17:16.187 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.184+0000 7fa3897fa640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa360079500 0x7fa360099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.187 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.184+0000 7fa3897fa640 1 -- 10.20.193.12:0/2938480853 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fa37c040070 con 0x7fa3840b3e90 2026-02-13T21:17:16.187 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.184+0000 7fa38bfff640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa360079500 0x7fa360099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.188 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.186+0000 7fa38bfff640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa360079500 0x7fa360099a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa378004770 tx=0x7fa378009240 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.192 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.187+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/4152549376 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805d120 msgr2=0x7f1a1805d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.192 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.187+0000 7f1a1fcbd640 1 --2- 10.20.193.12:0/4152549376 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805d120 0x7f1a1805d570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c005fd0 tx=0x7f1a0c02fa80 comp rx=0 tx=0).stop 2026-02-13T21:17:16.192 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.188+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/4152549376 shutdown_connections 2026-02-13T21:17:16.192 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.188+0000 7f1a1fcbd640 1 --2- 10.20.193.12:0/4152549376 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a1805dbb0 0x7f1a1805bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.192 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.189+0000 7f1a1fcbd640 1 --2- 10.20.193.12:0/4152549376 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805d120 0x7f1a1805d570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.192 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.189+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/4152549376 >> 10.20.193.12:0/4152549376 conn(0x7f1a18059240 msgr2=0x7f1a180596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.192 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.189+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/4152549376 shutdown_connections 2026-02-13T21:17:16.193 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.189+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/4152549376 wait complete. 2026-02-13T21:17:16.196 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.190+0000 7f1a1fcbd640 1 Processor -- start 2026-02-13T21:17:16.196 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.191+0000 7f1a1fcbd640 1 -- start start 2026-02-13T21:17:16.196 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.191+0000 7f1a1fcbd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a1805d120 0x7f1a1811f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.196 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.191+0000 7f1a1fcbd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805dbb0 0x7f1a1811f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.196 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1fcbd640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a18155a60 con 0x7f1a1805dbb0 2026-02-13T21:17:16.196 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1fcbd640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a181558e0 con 0x7f1a1805d120 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1d231640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805dbb0 0x7f1a1811f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1d231640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805dbb0 0x7f1a1811f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52018/0 (socket says 10.20.193.12:52018) 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1d231640 1 -- 10.20.193.12:0/1871758855 learned_addr learned my addr 10.20.193.12:0/1871758855 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1d231640 1 -- 10.20.193.12:0/1871758855 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a1805d120 msgr2=0x7f1a1811f140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1d231640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a1805d120 0x7f1a1811f140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1d231640 1 -- 10.20.193.12:0/1871758855 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a18120290 con 0x7f1a1805dbb0 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.192+0000 7f1a1d231640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805dbb0 0x7f1a1811f7b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a08005de0 tx=0x7f1a0800dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.193+0000 7f1a06ffd640 1 -- 10.20.193.12:0/1871758855 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1a08014070 con 0x7f1a1805dbb0 2026-02-13T21:17:16.197 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.193+0000 7f1a06ffd640 1 -- 10.20.193.12:0/1871758855 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1a08004cf0 con 0x7f1a1805dbb0 2026-02-13T21:17:16.198 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.190+0000 7fa3897fa640 1 -- 10.20.193.12:0/2938480853 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fa37c090370 con 0x7fa3840b3e90 2026-02-13T21:17:16.198 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.194+0000 7f1a06ffd640 1 -- 10.20.193.12:0/1871758855 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1a0800bda0 con 0x7f1a1805dbb0 2026-02-13T21:17:16.200 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.194+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a18120580 con 0x7f1a1805dbb0 2026-02-13T21:17:16.200 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.194+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a18120b60 con 0x7f1a1805dbb0 2026-02-13T21:17:16.200 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.195+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1805d530 con 0x7f1a1805dbb0 2026-02-13T21:17:16.200 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.196+0000 7f1a06ffd640 1 -- 10.20.193.12:0/1871758855 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f1a080047a0 con 0x7f1a1805dbb0 2026-02-13T21:17:16.200 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.197+0000 7f1a06ffd640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19f4079500 0x7f19f4099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.200 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.197+0000 7f1a06ffd640 1 -- 10.20.193.12:0/1871758855 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f1a0809b730 con 0x7f1a1805dbb0 2026-02-13T21:17:16.204 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.199+0000 7f1a1da32640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19f4079500 0x7f19f4099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.207 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.201+0000 7f1a06ffd640 1 -- 10.20.193.12:0/1871758855 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f1a0800e350 con 0x7f1a1805dbb0 2026-02-13T21:17:16.208 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.205+0000 7f1a1da32640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19f4079500 0x7f19f4099a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c005fd0 tx=0x7f1a0c0023c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.228 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.229 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.226+0000 7fa46d777640 1 -- 10.20.193.12:0/2352138676 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fa4680f8090 con 0x7fa468061ef0 2026-02-13T21:17:16.231 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.241 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.239+0000 7fa3897fa640 1 -- 10.20.193.12:0/2938480853 <== mon.0 v2:10.20.193.12:3300/0 7 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fa37c095470 con 0x7fa3840b3e90 2026-02-13T21:17:16.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.239+0000 7fd63bfff640 1 -- 10.20.193.12:0/4071454974 <== mon.0 v2:10.20.193.12:3300/0 9 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fd650093120 con 0x7fd65c109480 2026-02-13T21:17:16.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.240+0000 7f1a06ffd640 1 -- 10.20.193.12:0/1871758855 <== mon.0 v2:10.20.193.12:3300/0 7 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f1a08069950 con 0x7f1a1805dbb0 2026-02-13T21:17:16.244 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.239+0000 7fa447fff640 1 -- 10.20.193.12:0/2352138676 <== mon.0 v2:10.20.193.12:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7fa450060110 con 0x7fa468061ef0 2026-02-13T21:17:16.244 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.240+0000 7fa447fff640 1 -- 10.20.193.12:0/2352138676 <== mon.0 v2:10.20.193.12:3300/0 10 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fa450063920 con 0x7fa468061ef0 2026-02-13T21:17:16.244 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.239+0000 7f95e7fff640 1 -- 10.20.193.12:0/1833166071 <== mon.0 v2:10.20.193.12:3300/0 9 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f95f0063a60 con 0x7f9608132000 2026-02-13T21:17:16.245 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.240+0000 7f391d217640 1 -- 10.20.193.12:0/3463197599 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805c4d0 msgr2=0x7f391805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.245 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.240+0000 7f391d217640 1 --2- 10.20.193.12:0/3463197599 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805c4d0 0x7f391805c9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3900009840 tx=0x7f390002f160 comp rx=0 tx=0).stop 2026-02-13T21:17:16.248 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.249 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.243+0000 7f391d217640 1 -- 10.20.193.12:0/3463197599 shutdown_connections 2026-02-13T21:17:16.249 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.243+0000 7f391d217640 1 --2- 10.20.193.12:0/3463197599 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805c4d0 0x7f391805c9a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.249 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.243+0000 7f391d217640 1 --2- 10.20.193.12:0/3463197599 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805e2d0 0x7f391805beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.249 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.243+0000 7f391d217640 1 -- 10.20.193.12:0/3463197599 >> 10.20.193.12:0/3463197599 conn(0x7f3918059b40 msgr2=0x7f3918059f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.245+0000 7f391d217640 1 -- 10.20.193.12:0/3463197599 shutdown_connections 2026-02-13T21:17:16.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.245+0000 7f391d217640 1 -- 10.20.193.12:0/3463197599 wait complete. 2026-02-13T21:17:16.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.246+0000 7f391d217640 1 Processor -- start 2026-02-13T21:17:16.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.246+0000 7f391d217640 1 -- start start 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.246+0000 7f391d217640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 0x7f39181b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f391d217640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805e2d0 0x7f39181b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f391d217640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3918115b60 con 0x7f391805e2d0 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f391d217640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39181159e0 con 0x7f391805c4d0 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f3916d76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 0x7f39181b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f3916d76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 0x7f39181b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.12:46494/0 (socket says 10.20.193.12:46494) 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f3916d76640 1 -- 10.20.193.12:0/2756038959 learned_addr learned my addr 10.20.193.12:0/2756038959 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f3916d76640 1 -- 10.20.193.12:0/2756038959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 msgr2=0x7f39181b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T21:17:16.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f3916d76640 1 -- 10.20.193.12:0/2756038959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 msgr2=0x7f39181b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f3916d76640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 0x7f39181b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.247+0000 7f3916d76640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 0x7f39181b1c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.248+0000 7fa46d777640 1 -- 10.20.193.12:0/2352138676 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa43c079430 msgr2=0x7fa43c099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.248+0000 7fa46d777640 1 --2- 10.20.193.12:0/2352138676 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa43c079430 0x7fa43c099940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa45c02f630 tx=0x7fa45c0023c0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.248+0000 7fa46d777640 1 -- 10.20.193.12:0/2352138676 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa468061ef0 msgr2=0x7fa4680f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.248+0000 7fa46d777640 1 --2- 10.20.193.12:0/2352138676 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa468061ef0 0x7fa4680f6a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4500059a0 tx=0x7fa45000db40 comp rx=0 tx=0).stop 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.249+0000 7fa46d777640 1 -- 10.20.193.12:0/2352138676 shutdown_connections 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.249+0000 7fa46d777640 1 --2- 10.20.193.12:0/2352138676 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa43c079430 0x7fa43c099940 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.249+0000 7fa46d777640 1 --2- 10.20.193.12:0/2352138676 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa468061ef0 0x7fa4680f6a10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.249+0000 7fa46d777640 1 --2- 10.20.193.12:0/2352138676 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa468060dc0 0x7fa4680f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.249+0000 7fa46d777640 1 -- 10.20.193.12:0/2352138676 >> 10.20.193.12:0/2352138676 conn(0x7fa4680e9f20 msgr2=0x7fa4680ec700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.250+0000 7fa46d777640 1 -- 10.20.193.12:0/2352138676 shutdown_connections 2026-02-13T21:17:16.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.250+0000 7f3916575640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805e2d0 0x7f39181b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.250+0000 7fa46d777640 1 -- 10.20.193.12:0/2352138676 wait complete. 2026-02-13T21:17:16.255 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.251+0000 7f3916575640 1 -- 10.20.193.12:0/2756038959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 msgr2=0x7f39181b1c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.255 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.251+0000 7f3916575640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 0x7f39181b1c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.255 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.251+0000 7f3916575640 1 -- 10.20.193.12:0/2756038959 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39181b2df0 con 0x7f391805e2d0 2026-02-13T21:17:16.255 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.251+0000 7f3916575640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805e2d0 0x7f39181b22a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f390002f670 tx=0x7f3900005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.255 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.251+0000 7f38f7fff640 1 -- 10.20.193.12:0/2756038959 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3900046070 con 0x7f391805e2d0 2026-02-13T21:17:16.256 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.252+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39181b3080 con 0x7f391805e2d0 2026-02-13T21:17:16.256 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.252+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39181b35b0 con 0x7f391805e2d0 2026-02-13T21:17:16.256 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.252+0000 7f38f7fff640 1 -- 10.20.193.12:0/2756038959 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f3900004490 con 0x7f391805e2d0 2026-02-13T21:17:16.256 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.252+0000 7f38f7fff640 1 -- 10.20.193.12:0/2756038959 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f39000417c0 con 0x7f391805e2d0 2026-02-13T21:17:16.256 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.253+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391805be70 con 0x7f391805e2d0 2026-02-13T21:17:16.257 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.254+0000 7f38f7fff640 1 -- 10.20.193.12:0/2756038959 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f3900038b20 con 0x7f391805e2d0 2026-02-13T21:17:16.258 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.255+0000 7f38f7fff640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38ec079500 0x7f38ec099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.258 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.255+0000 7f38f7fff640 1 -- 10.20.193.12:0/2756038959 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f390003e070 con 0x7f391805e2d0 2026-02-13T21:17:16.262 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.260+0000 7f3916d76640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38ec079500 0x7f38ec099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.263 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.261+0000 7f3916d76640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38ec079500 0x7f38ec099a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f390c005b60 tx=0x7f390c004400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.265 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.263+0000 7f38f7fff640 1 -- 10.20.193.12:0/2756038959 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f390008e020 con 0x7f391805e2d0 2026-02-13T21:17:16.267 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.267 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Updating trial012:/etc/ceph/ceph.conf 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Updating trial090:/etc/ceph/ceph.conf 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Updating trial090:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Updating trial012:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/config/ceph.conf 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Reconfiguring mon.trial012 (unknown last config time)... 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Reconfiguring daemon mon.trial012 on trial012 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Reconfiguring mgr.trial012.zqhrrq (unknown last config time)... 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Reconfiguring daemon mgr.trial012.zqhrrq on trial012 2026-02-13T21:17:16.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Reconfiguring ceph-exporter.trial012 (monmap changed)... 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial012", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: Reconfiguring daemon ceph-exporter.trial012 on trial012 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/3785029360' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.trial012", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:16.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1586759610' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:16.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:16.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:16.289 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.286+0000 7fd66146e640 1 -- 10.20.193.12:0/4071454974 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fd65c1131d0 con 0x7fd65c109480 2026-02-13T21:17:16.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.297+0000 7fd63bfff640 1 -- 10.20.193.12:0/4071454974 <== mon.0 v2:10.20.193.12:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v16)=0 v16) ==== 108+0+0 (secure 0 0 0) 0x7fd6500900b0 con 0x7fd65c109480 2026-02-13T21:17:16.301 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.296+0000 7f746fbce640 1 -- 10.20.193.12:0/1390777511 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 msgr2=0x7f746810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.301 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.296+0000 7f746fbce640 1 --2- 10.20.193.12:0/1390777511 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 0x7f746810bb30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f745000fba0 tx=0x7f74500333f0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.301 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.296+0000 7f746fbce640 1 -- 10.20.193.12:0/1390777511 shutdown_connections 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.296+0000 7f746fbce640 1 --2- 10.20.193.12:0/1390777511 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 0x7f746810bb30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.296+0000 7f746fbce640 1 --2- 10.20.193.12:0/1390777511 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 0x7f746810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.296+0000 7f746fbce640 1 -- 10.20.193.12:0/1390777511 >> 10.20.193.12:0/1390777511 conn(0x7f74680e7c90 msgr2=0x7f7468108140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.296+0000 7f746fbce640 1 -- 10.20.193.12:0/1390777511 shutdown_connections 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.296+0000 7f746fbce640 1 -- 10.20.193.12:0/1390777511 wait complete. 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.297+0000 7f746fbce640 1 Processor -- start 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.297+0000 7f746fbce640 1 -- start start 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746fbce640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 0x7f74680f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746fbce640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 0x7f74680f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746fbce640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f746814d1d0 con 0x7f746810b720 2026-02-13T21:17:16.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746fbce640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f746814d050 con 0x7f746810a5f0 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d943640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 0x7f74680f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d943640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 0x7f74680f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.12:46510/0 (socket says 10.20.193.12:46510) 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d943640 1 -- 10.20.193.12:0/3746732229 learned_addr learned my addr 10.20.193.12:0/3746732229 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d142640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 0x7f74680f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d943640 1 -- 10.20.193.12:0/3746732229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 msgr2=0x7f74680f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d943640 1 -- 10.20.193.12:0/3746732229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 msgr2=0x7f74680f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d943640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 0x7f74680f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d943640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 0x7f74680f3f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d142640 1 -- 10.20.193.12:0/3746732229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 msgr2=0x7f74680f3f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d142640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 0x7f74680f3f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d142640 1 -- 10.20.193.12:0/3746732229 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74680f50d0 con 0x7f746810b720 2026-02-13T21:17:16.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.298+0000 7f746d142640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 0x7f74680f4580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f745000fba0 tx=0x7f7450003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.304 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.299+0000 7f745effd640 1 -- 10.20.193.12:0/3746732229 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f745004b070 con 0x7f746810b720 2026-02-13T21:17:16.304 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.299+0000 7f745effd640 1 -- 10.20.193.12:0/3746732229 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f7450003e80 con 0x7f746810b720 2026-02-13T21:17:16.304 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.299+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74680f5360 con 0x7f746810b720 2026-02-13T21:17:16.304 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.299+0000 7f745effd640 1 -- 10.20.193.12:0/3746732229 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7450046780 con 0x7f746810b720 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.302+0000 7fd66146e640 1 -- 10.20.193.12:0/4071454974 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd630079360 msgr2=0x7fd630099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.302+0000 7fd66146e640 1 --2- 10.20.193.12:0/4071454974 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd630079360 0x7fd630099870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd644005b60 tx=0x7fd644004050 comp rx=0 tx=0).stop 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.302+0000 7fd66146e640 1 -- 10.20.193.12:0/4071454974 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd65c109480 msgr2=0x7fd65c1115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.302+0000 7fd66146e640 1 --2- 10.20.193.12:0/4071454974 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd65c109480 0x7fd65c1115a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd650009840 tx=0x7fd650031dd0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.303+0000 7fd66146e640 1 -- 10.20.193.12:0/4071454974 shutdown_connections 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.303+0000 7fd66146e640 1 --2- 10.20.193.12:0/4071454974 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd630079360 0x7fd630099870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.303+0000 7fd66146e640 1 --2- 10.20.193.12:0/4071454974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd65c10a5b0 0x7fd65c111c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.303+0000 7fd66146e640 1 --2- 10.20.193.12:0/4071454974 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd65c109480 0x7fd65c1115a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.303+0000 7fd66146e640 1 -- 10.20.193.12:0/4071454974 >> 10.20.193.12:0/4071454974 conn(0x7fd65c0e6b40 msgr2=0x7fd65c106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.308 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.303+0000 7fd66146e640 1 -- 10.20.193.12:0/4071454974 shutdown_connections 2026-02-13T21:17:16.309 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.303+0000 7fd66146e640 1 -- 10.20.193.12:0/4071454974 wait complete. 2026-02-13T21:17:16.309 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.299+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74680f5910 con 0x7f746810b720 2026-02-13T21:17:16.309 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.300+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746810bb30 con 0x7f746810b720 2026-02-13T21:17:16.309 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.301+0000 7f745effd640 1 -- 10.20.193.12:0/3746732229 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f74500469e0 con 0x7f746810b720 2026-02-13T21:17:16.309 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.301+0000 7f745effd640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7444079430 0x7f7444099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.309 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.301+0000 7f745effd640 1 -- 10.20.193.12:0/3746732229 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f7450043070 con 0x7f746810b720 2026-02-13T21:17:16.309 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.301+0000 7f746d943640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7444079430 0x7f7444099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.309 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.302+0000 7f746d943640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7444079430 0x7f7444099940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7458005b60 tx=0x7f7458004050 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.310 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.306+0000 7f960d4be640 1 -- 10.20.193.12:0/1833166071 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f9608058760 con 0x7f9608132000 2026-02-13T21:17:16.310 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.307+0000 7f745effd640 1 -- 10.20.193.12:0/3746732229 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f7450092a00 con 0x7f746810b720 2026-02-13T21:17:16.313 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.315 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.313+0000 7f95e7fff640 1 -- 10.20.193.12:0/1833166071 <== mon.0 v2:10.20.193.12:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7f95f0063c10 con 0x7f9608132000 2026-02-13T21:17:16.315 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.317 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.317 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.312+0000 7f9951856640 1 -- 10.20.193.12:0/2798429526 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c054da0 msgr2=0x7f994c109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.312+0000 7f9951856640 1 --2- 10.20.193.12:0/2798429526 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c054da0 0x7f994c109050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9934009840 tx=0x7f993402f140 comp rx=0 tx=0).stop 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.312+0000 7f9951856640 1 -- 10.20.193.12:0/2798429526 shutdown_connections 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.312+0000 7f9951856640 1 --2- 10.20.193.12:0/2798429526 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c109590 0x7f994c1099a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.312+0000 7f9951856640 1 --2- 10.20.193.12:0/2798429526 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c054da0 0x7f994c109050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.312+0000 7f9951856640 1 -- 10.20.193.12:0/2798429526 >> 10.20.193.12:0/2798429526 conn(0x7f994c0e6b40 msgr2=0x7f994c106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.312+0000 7f9951856640 1 -- 10.20.193.12:0/2798429526 shutdown_connections 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.312+0000 7f9951856640 1 -- 10.20.193.12:0/2798429526 wait complete. 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.313+0000 7f9951856640 1 Processor -- start 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.313+0000 7f9951856640 1 -- start start 2026-02-13T21:17:16.318 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.313+0000 7f9951856640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 0x7f994c1041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.313+0000 7f9951856640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c109590 0x7f994c104820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.313+0000 7f9951856640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f994c10d140 con 0x7f994c109590 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.313+0000 7f9951856640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f994c10cfc0 con 0x7f994c054da0 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994affd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 0x7f994c1041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994affd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 0x7f994c1041b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.12:46522/0 (socket says 10.20.193.12:46522) 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994affd640 1 -- 10.20.193.12:0/3423371769 learned_addr learned my addr 10.20.193.12:0/3423371769 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994affd640 1 -- 10.20.193.12:0/3423371769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 msgr2=0x7f994c1041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994affd640 1 -- 10.20.193.12:0/3423371769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 msgr2=0x7f994c1041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994affd640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 0x7f994c1041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994affd640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 0x7f994c1041b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.319 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994a7fc640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c109590 0x7f994c104820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.320 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994a7fc640 1 -- 10.20.193.12:0/3423371769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 msgr2=0x7f994c1041b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.320 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994a7fc640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 0x7f994c1041b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.320 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994a7fc640 1 -- 10.20.193.12:0/3423371769 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c105370 con 0x7f994c109590 2026-02-13T21:17:16.320 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f994a7fc640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c109590 0x7f994c104820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f993c009750 tx=0x7f993c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.320 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f9950854640 1 -- 10.20.193.12:0/3423371769 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f993c009e60 con 0x7f994c109590 2026-02-13T21:17:16.320 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.314+0000 7f9950854640 1 -- 10.20.193.12:0/3423371769 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f993c007590 con 0x7f994c109590 2026-02-13T21:17:16.320 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.315+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c105600 con 0x7f994c109590 2026-02-13T21:17:16.321 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.315+0000 7f9950854640 1 -- 10.20.193.12:0/3423371769 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f993c0136a0 con 0x7f994c109590 2026-02-13T21:17:16.321 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.315+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c105b90 con 0x7f994c109590 2026-02-13T21:17:16.321 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f7bd14fa640 1 -- 10.20.193.12:0/1797111198 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc1094b0 msgr2=0x7f7bcc109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.321 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f7bd14fa640 1 --2- 10.20.193.12:0/1797111198 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc1094b0 0x7f7bcc109920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0005fd0 tx=0x7f7bc002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.321 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f7bd14fa640 1 -- 10.20.193.12:0/1797111198 shutdown_connections 2026-02-13T21:17:16.322 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f7bd14fa640 1 --2- 10.20.193.12:0/1797111198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc10a5e0 0x7f7bcc10a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.322 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f7bd14fa640 1 --2- 10.20.193.12:0/1797111198 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc1094b0 0x7f7bcc109920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.322 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f7bd14fa640 1 -- 10.20.193.12:0/1797111198 >> 10.20.193.12:0/1797111198 conn(0x7f7bcc0e6b50 msgr2=0x7f7bcc107000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.322 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f7bd14fa640 1 -- 10.20.193.12:0/1797111198 shutdown_connections 2026-02-13T21:17:16.322 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f7bd14fa640 1 -- 10.20.193.12:0/1797111198 wait complete. 2026-02-13T21:17:16.322 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.316+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994c109050 con 0x7f994c109590 2026-02-13T21:17:16.323 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.318+0000 7f9950854640 1 -- 10.20.193.12:0/3423371769 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f993c012070 con 0x7f994c109590 2026-02-13T21:17:16.323 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.318+0000 7f9950854640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9924079430 0x7f9924099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.323 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.318+0000 7f9950854640 1 -- 10.20.193.12:0/3423371769 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f993c09adc0 con 0x7f994c109590 2026-02-13T21:17:16.323 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f994affd640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9924079430 0x7f9924099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.323 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f960d4be640 1 -- 10.20.193.12:0/1833166071 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f95dc079430 msgr2=0x7f95dc099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.323 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f960d4be640 1 --2- 10.20.193.12:0/1833166071 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f95dc079430 0x7f95dc099940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f95fc005a20 tx=0x7f95fc0026d0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f960d4be640 1 -- 10.20.193.12:0/1833166071 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9608132000 msgr2=0x7f9608105e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f960d4be640 1 --2- 10.20.193.12:0/1833166071 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9608132000 0x7f9608105e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f95f0005b60 tx=0x7f95f000dd70 comp rx=0 tx=0).stop 2026-02-13T21:17:16.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.318+0000 7f7bd14fa640 1 Processor -- start 2026-02-13T21:17:16.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.318+0000 7f7bd14fa640 1 -- start start 2026-02-13T21:17:16.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.318+0000 7f7bd14fa640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 0x7f7bcc111360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f7bd14fa640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc10a5e0 0x7f7bcc1119d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f7bca7fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc10a5e0 0x7f7bcc1119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f7bca7fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc10a5e0 0x7f7bcc1119d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52078/0 (socket says 10.20.193.12:52078) 2026-02-13T21:17:16.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f7bca7fc640 1 -- 10.20.193.12:0/4194597076 learned_addr learned my addr 10.20.193.12:0/4194597076 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc056560 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0563e0 con 0x7f7bcc1094b0 2026-02-13T21:17:16.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.320+0000 7f7bcaffd640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 0x7f7bcc111360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.320+0000 7f960d4be640 1 -- 10.20.193.12:0/1833166071 shutdown_connections 2026-02-13T21:17:16.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.320+0000 7f960d4be640 1 --2- 10.20.193.12:0/1833166071 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f95dc079430 0x7f95dc099940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.320+0000 7f960d4be640 1 --2- 10.20.193.12:0/1833166071 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9608132000 0x7f9608105e00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.320+0000 7f960d4be640 1 --2- 10.20.193.12:0/1833166071 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f96081116a0 0x7f9608152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.320+0000 7f960d4be640 1 -- 10.20.193.12:0/1833166071 >> 10.20.193.12:0/1833166071 conn(0x7f9608061cd0 msgr2=0x7f9608055d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.321+0000 7f960d4be640 1 -- 10.20.193.12:0/1833166071 shutdown_connections 2026-02-13T21:17:16.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.321+0000 7f960d4be640 1 -- 10.20.193.12:0/1833166071 wait complete. 2026-02-13T21:17:16.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.319+0000 7f994affd640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9924079430 0x7f9924099940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9934002400 tx=0x7f9934005930 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.323+0000 7f7bcaffd640 1 -- 10.20.193.12:0/4194597076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 msgr2=0x7f7bcc111360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-13T21:17:16.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.323+0000 7f7bcaffd640 1 -- 10.20.193.12:0/4194597076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 msgr2=0x7f7bcc111360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.323+0000 7f7bcaffd640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 0x7f7bcc111360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.323+0000 7f7bcaffd640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 0x7f7bcc111360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.324+0000 7f7bca7fc640 1 -- 10.20.193.12:0/4194597076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 msgr2=0x7f7bcc111360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.324+0000 7f7bca7fc640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 0x7f7bcc111360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.324+0000 7f7bca7fc640 1 -- 10.20.193.12:0/4194597076 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc1125c0 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.328 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.324+0000 7f9950854640 1 -- 10.20.193.12:0/3423371769 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f993c010070 con 0x7f994c109590 2026-02-13T21:17:16.331 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.328+0000 7f7bca7fc640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc10a5e0 0x7f7bcc1119d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400d8d0 tx=0x7f7bb400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.331 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.328+0000 7f7babfff640 1 -- 10.20.193.12:0/4194597076 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7bb4014070 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.331 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.328+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc1128b0 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.331 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.328+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc112e00 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.331 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.329+0000 7f7babfff640 1 -- 10.20.193.12:0/4194597076 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f7bb400bcd0 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.334 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.331+0000 7f7babfff640 1 -- 10.20.193.12:0/4194597076 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7bb401e060 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.334 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.331+0000 7f7babfff640 1 -- 10.20.193.12:0/4194597076 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f7bb4002c20 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.333+0000 7f7babfff640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7b98079280 0x7f7b98099790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.333+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc056d40 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.339 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.334+0000 7f7bcaffd640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7b98079280 0x7f7b98099790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.339 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.337+0000 7f7babfff640 1 -- 10.20.193.12:0/4194597076 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f7bb409c520 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.339 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.337+0000 7f7bcaffd640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7b98079280 0x7f7b98099790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009900 tx=0x7f7bc003a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.343 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.341+0000 7f7babfff640 1 -- 10.20.193.12:0/4194597076 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f7bb406a7c0 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.347 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.354 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.369 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:16.376 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.373+0000 7f0abdea7640 1 -- 10.20.193.12:0/2761883185 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 msgr2=0x7f0ab81098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.376 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.373+0000 7f0abdea7640 1 --2- 10.20.193.12:0/2761883185 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 0x7f0ab81098f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009890 tx=0x7f0aa802f170 comp rx=0 tx=0).stop 2026-02-13T21:17:16.377 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.370+0000 7fa35effd640 1 -- 10.20.193.12:0/2938480853 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fa354005680 con 0x7fa3840b3e90 2026-02-13T21:17:16.377 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.375+0000 7f0abdea7640 1 -- 10.20.193.12:0/2761883185 shutdown_connections 2026-02-13T21:17:16.378 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.375+0000 7f0abdea7640 1 --2- 10.20.193.12:0/2761883185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 0x7f0ab810a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.378 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.375+0000 7f0abdea7640 1 --2- 10.20.193.12:0/2761883185 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 0x7f0ab81098f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.378 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.375+0000 7f0abdea7640 1 -- 10.20.193.12:0/2761883185 >> 10.20.193.12:0/2761883185 conn(0x7f0ab80e6b40 msgr2=0x7f0ab8106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.378 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.376+0000 7f0abdea7640 1 -- 10.20.193.12:0/2761883185 shutdown_connections 2026-02-13T21:17:16.379 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.376+0000 7f0abdea7640 1 -- 10.20.193.12:0/2761883185 wait complete. 2026-02-13T21:17:16.379 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.377+0000 7f0abdea7640 1 Processor -- start 2026-02-13T21:17:16.383 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.381+0000 7f0abdea7640 1 -- start start 2026-02-13T21:17:16.384 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.381+0000 7f0abdea7640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 0x7f0ab80ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.384 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.381+0000 7f0abdea7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 0x7f0ab80eae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.384 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.381+0000 7f0abdea7640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab814e2b0 con 0x7f0ab8109480 2026-02-13T21:17:16.384 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0abdea7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab814e130 con 0x7f0ab810a5b0 2026-02-13T21:17:16.385 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab77fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 0x7f0ab80ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.385 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab77fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 0x7f0ab80ea7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52088/0 (socket says 10.20.193.12:52088) 2026-02-13T21:17:16.385 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab77fe640 1 -- 10.20.193.12:0/1192521333 learned_addr learned my addr 10.20.193.12:0/1192521333 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.385 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab6ffd640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 0x7f0ab80eae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.385 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab6ffd640 1 -- 10.20.193.12:0/1192521333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 msgr2=0x7f0ab80eae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-13T21:17:16.385 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab6ffd640 1 -- 10.20.193.12:0/1192521333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 msgr2=0x7f0ab80eae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.386 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab6ffd640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 0x7f0ab80eae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.386 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab6ffd640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 0x7f0ab80eae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.386 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab77fe640 1 -- 10.20.193.12:0/1192521333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 msgr2=0x7f0ab80eae10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.386 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab77fe640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 0x7f0ab80eae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.386 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.382+0000 7f0ab77fe640 1 -- 10.20.193.12:0/1192521333 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab80e92f0 con 0x7f0ab8109480 2026-02-13T21:17:16.386 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.383+0000 7f0ab77fe640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 0x7f0ab80ea7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8002e70 tx=0x7f0aa80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.388 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.385+0000 7f0ab4ff9640 1 -- 10.20.193.12:0/1192521333 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0aa8046070 con 0x7f0ab8109480 2026-02-13T21:17:16.388 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.385+0000 7f0ab4ff9640 1 -- 10.20.193.12:0/1192521333 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f0aa8038ac0 con 0x7f0ab8109480 2026-02-13T21:17:16.388 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.385+0000 7f0ab4ff9640 1 -- 10.20.193.12:0/1192521333 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0aa803d070 con 0x7f0ab8109480 2026-02-13T21:17:16.388 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.385+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab80e9580 con 0x7f0ab8109480 2026-02-13T21:17:16.388 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.385+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab80e9ab0 con 0x7f0ab8109480 2026-02-13T21:17:16.389 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.386+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab810a9c0 con 0x7f0ab8109480 2026-02-13T21:17:16.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.387+0000 7fa3897fa640 1 -- 10.20.193.12:0/2938480853 <== mon.0 v2:10.20.193.12:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fa37c03ad50 con 0x7fa3840b3e90 2026-02-13T21:17:16.395 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.392+0000 7f0ab4ff9640 1 -- 10.20.193.12:0/1192521333 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f0aa8038630 con 0x7f0ab8109480 2026-02-13T21:17:16.396 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.393+0000 7f0ab4ff9640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0a8c079430 0x7f0a8c099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.396 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.393+0000 7f0ab4ff9640 1 -- 10.20.193.12:0/1192521333 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f0aa80c0370 con 0x7f0ab8109480 2026-02-13T21:17:16.397 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.393+0000 7f0ab4ff9640 1 -- 10.20.193.12:0/1192521333 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f0aa804f070 con 0x7f0ab8109480 2026-02-13T21:17:16.397 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.394+0000 7f0ab6ffd640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0a8c079430 0x7f0a8c099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.397 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.394+0000 7f0ab6ffd640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0a8c079430 0x7f0a8c099940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4005ea0 tx=0x7f0aa4004050 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.394+0000 7fa35effd640 1 -- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa360079500 msgr2=0x7fa360099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.394+0000 7fa35effd640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa360079500 0x7fa360099a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa378004770 tx=0x7fa378009240 comp rx=0 tx=0).stop 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.394+0000 7fa35effd640 1 -- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 msgr2=0x7fa38409ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.394+0000 7fa35effd640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 0x7fa38409ce90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa37c004790 tx=0x7fa37c005d70 comp rx=0 tx=0).stop 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.395+0000 7fa35effd640 1 -- 10.20.193.12:0/2938480853 shutdown_connections 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.395+0000 7fa35effd640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa360079500 0x7fa360099a10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.395+0000 7fa35effd640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa3840b3e90 0x7fa38409ce90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.395+0000 7fa35effd640 1 --2- 10.20.193.12:0/2938480853 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3840b2d60 0x7fa38409c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.395+0000 7fa35effd640 1 -- 10.20.193.12:0/2938480853 >> 10.20.193.12:0/2938480853 conn(0x7fa384090400 msgr2=0x7fa384092ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.395+0000 7fa35effd640 1 -- 10.20.193.12:0/2938480853 shutdown_connections 2026-02-13T21:17:16.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.395+0000 7fa35effd640 1 -- 10.20.193.12:0/2938480853 wait complete. 2026-02-13T21:17:16.400 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.401 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.401 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.398+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f1a18120e10 con 0x7f1a1805dbb0 2026-02-13T21:17:16.405 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.402+0000 7f1a06ffd640 1 -- 10.20.193.12:0/1871758855 <== mon.0 v2:10.20.193.12:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7f1a08004ac0 con 0x7f1a1805dbb0 2026-02-13T21:17:16.408 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.406+0000 7f050f3e0640 1 -- 10.20.193.12:0/2718088147 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 msgr2=0x7f050810aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.409 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.406+0000 7f050f3e0640 1 --2- 10.20.193.12:0/2718088147 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 0x7f050810aa60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005fd0 tx=0x7f04f802f1f0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.409 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.406+0000 7f050f3e0640 1 -- 10.20.193.12:0/2718088147 shutdown_connections 2026-02-13T21:17:16.409 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.406+0000 7f050f3e0640 1 --2- 10.20.193.12:0/2718088147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 0x7f050810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.409 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.406+0000 7f050f3e0640 1 --2- 10.20.193.12:0/2718088147 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 0x7f050810aa60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.409 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.406+0000 7f050f3e0640 1 -- 10.20.193.12:0/2718088147 >> 10.20.193.12:0/2718088147 conn(0x7f05080e7c90 msgr2=0x7f0508108140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.409 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.406+0000 7f050f3e0640 1 -- 10.20.193.12:0/2718088147 shutdown_connections 2026-02-13T21:17:16.410 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.407+0000 7f050f3e0640 1 -- 10.20.193.12:0/2718088147 wait complete. 2026-02-13T21:17:16.410 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.407+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19f4079500 msgr2=0x7f19f4099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.410 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.407+0000 7f1a1fcbd640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19f4079500 0x7f19f4099a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c005fd0 tx=0x7f1a0c0023c0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.410 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.407+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805dbb0 msgr2=0x7f1a1811f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.411 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.407+0000 7f1a1fcbd640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805dbb0 0x7f1a1811f7b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a08005de0 tx=0x7f1a0800dd70 comp rx=0 tx=0).stop 2026-02-13T21:17:16.411 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.408+0000 7f050f3e0640 1 Processor -- start 2026-02-13T21:17:16.411 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.408+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 shutdown_connections 2026-02-13T21:17:16.412 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.408+0000 7f1a1fcbd640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19f4079500 0x7f19f4099a10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.412 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.408+0000 7f1a1fcbd640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a1805dbb0 0x7f1a1811f7b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.412 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.408+0000 7f1a1fcbd640 1 --2- 10.20.193.12:0/1871758855 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a1805d120 0x7f1a1811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.412 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.408+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 >> 10.20.193.12:0/1871758855 conn(0x7f1a18059240 msgr2=0x7f1a181153f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.413 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.408+0000 7f050f3e0640 1 -- start start 2026-02-13T21:17:16.413 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050f3e0640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 0x7f05080f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.413 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050f3e0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 0x7f05080f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050f3e0640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05080602b0 con 0x7f050810a5f0 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050f3e0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0508060130 con 0x7f050810b720 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050c954640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 0x7f05080f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050c954640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 0x7f05080f9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.12:46572/0 (socket says 10.20.193.12:46572) 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050c954640 1 -- 10.20.193.12:0/15224607 learned_addr learned my addr 10.20.193.12:0/15224607 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050c954640 1 -- 10.20.193.12:0/15224607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 msgr2=0x7f05080f9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050c954640 1 -- 10.20.193.12:0/15224607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 msgr2=0x7f05080f9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050d155640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 0x7f05080f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050c954640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 0x7f05080f9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050c954640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 0x7f05080f9b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.415 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050d155640 1 -- 10.20.193.12:0/15224607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 msgr2=0x7f05080f9b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.415 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050d155640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 0x7f05080f9b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.415 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050d155640 1 -- 10.20.193.12:0/15224607 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05080fa2e0 con 0x7f050810a5f0 2026-02-13T21:17:16.415 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.409+0000 7f050d155640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 0x7f05080f9540 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f04f8002400 tx=0x7f04f8005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.415 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.410+0000 7f04f67fc640 1 -- 10.20.193.12:0/15224607 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f04f802fd20 con 0x7f050810a5f0 2026-02-13T21:17:16.415 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.410+0000 7f04f67fc640 1 -- 10.20.193.12:0/15224607 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f04f8031070 con 0x7f050810a5f0 2026-02-13T21:17:16.415 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.410+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05080fa570 con 0x7f050810a5f0 2026-02-13T21:17:16.415 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.410+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05080fab20 con 0x7f050810a5f0 2026-02-13T21:17:16.416 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.411+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 shutdown_connections 2026-02-13T21:17:16.416 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.411+0000 7f1a1fcbd640 1 -- 10.20.193.12:0/1871758855 wait complete. 2026-02-13T21:17:16.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.410+0000 7f04f67fc640 1 -- 10.20.193.12:0/15224607 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f04f8038690 con 0x7f050810a5f0 2026-02-13T21:17:16.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.411+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050814d980 con 0x7f050810a5f0 2026-02-13T21:17:16.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.412+0000 7f04f67fc640 1 -- 10.20.193.12:0/15224607 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f04f8031220 con 0x7f050810a5f0 2026-02-13T21:17:16.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.412+0000 7f04f67fc640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04e4079160 0x7f04e4099670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.412+0000 7f04f67fc640 1 -- 10.20.193.12:0/15224607 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f04f803f070 con 0x7f050810a5f0 2026-02-13T21:17:16.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.412+0000 7f050c954640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04e4079160 0x7f04e4099670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.413+0000 7f050c954640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04e4079160 0x7f04e4099670 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005fb0 tx=0x7f04fc004420 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.420 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.417+0000 7f04f67fc640 1 -- 10.20.193.12:0/15224607 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f04f80c8070 con 0x7f050810a5f0 2026-02-13T21:17:16.420 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.417+0000 7f4900f6e640 1 -- 10.20.193.12:0/3261258215 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 msgr2=0x7f48fc108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.420 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.417+0000 7f4900f6e640 1 --2- 10.20.193.12:0/3261258215 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 0x7f48fc108d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f48f0005fd0 tx=0x7f48f002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.421 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.419+0000 7f145e426640 1 -- 10.20.193.12:0/3183840481 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 msgr2=0x7f145810ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.422 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.419+0000 7f145e426640 1 --2- 10.20.193.12:0/3183840481 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 0x7f145810ccd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1444005fd0 tx=0x7f144402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.422 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f145e426640 1 -- 10.20.193.12:0/3183840481 shutdown_connections 2026-02-13T21:17:16.422 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f145e426640 1 --2- 10.20.193.12:0/3183840481 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f145810d990 0x7f145810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.423 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f145e426640 1 --2- 10.20.193.12:0/3183840481 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 0x7f145810ccd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.423 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f145e426640 1 -- 10.20.193.12:0/3183840481 >> 10.20.193.12:0/3183840481 conn(0x7f14580e9f20 msgr2=0x7f145810a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.423 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f4900f6e640 1 -- 10.20.193.12:0/3261258215 shutdown_connections 2026-02-13T21:17:16.423 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f4900f6e640 1 --2- 10.20.193.12:0/3261258215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48fc12bab0 0x7f48fc14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.424 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f4900f6e640 1 --2- 10.20.193.12:0/3261258215 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 0x7f48fc108d80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.424 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f4900f6e640 1 -- 10.20.193.12:0/3261258215 >> 10.20.193.12:0/3261258215 conn(0x7f48fc0e62b0 msgr2=0x7f48fc106760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.424 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f4900f6e640 1 -- 10.20.193.12:0/3261258215 shutdown_connections 2026-02-13T21:17:16.424 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.420+0000 7f4900f6e640 1 -- 10.20.193.12:0/3261258215 wait complete. 2026-02-13T21:17:16.424 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.421+0000 7f4900f6e640 1 Processor -- start 2026-02-13T21:17:16.424 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.421+0000 7f4900f6e640 1 -- start start 2026-02-13T21:17:16.425 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.421+0000 7f4900f6e640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 0x7f48fc106760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.425 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f4900f6e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48fc12bab0 0x7f48fc1178f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.425 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f48fa575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 0x7f48fc106760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.426 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f48fa575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 0x7f48fc106760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52134/0 (socket says 10.20.193.12:52134) 2026-02-13T21:17:16.426 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f48fa575640 1 -- 10.20.193.12:0/3806719735 learned_addr learned my addr 10.20.193.12:0/3806719735 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.426 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc14d180 con 0x7f48fc108950 2026-02-13T21:17:16.426 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc14d000 con 0x7f48fc12bab0 2026-02-13T21:17:16.426 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f145e426640 1 -- 10.20.193.12:0/3183840481 shutdown_connections 2026-02-13T21:17:16.426 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f145e426640 1 -- 10.20.193.12:0/3183840481 wait complete. 2026-02-13T21:17:16.427 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f48fa575640 1 -- 10.20.193.12:0/3806719735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48fc12bab0 msgr2=0x7f48fc1178f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T21:17:16.427 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f48fa575640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48fc12bab0 0x7f48fc1178f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.427 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.422+0000 7f48fa575640 1 -- 10.20.193.12:0/3806719735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc117fc0 con 0x7f48fc108950 2026-02-13T21:17:16.427 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f48fa575640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 0x7f48fc106760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48f00092e0 tx=0x7f48f0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.428 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f145e426640 1 Processor -- start 2026-02-13T21:17:16.428 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f145e426640 1 -- start start 2026-02-13T21:17:16.429 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f48e37fe640 1 -- 10.20.193.12:0/3806719735 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f48f0046070 con 0x7f48fc108950 2026-02-13T21:17:16.429 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f48e37fe640 1 -- 10.20.193.12:0/3806719735 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f48f0038900 con 0x7f48fc108950 2026-02-13T21:17:16.429 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f48e37fe640 1 -- 10.20.193.12:0/3806719735 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f48f0046070 con 0x7f48fc108950 2026-02-13T21:17:16.430 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f145e426640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 0x7f14581183d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.430 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f145e426640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f145810d990 0x7f1458118a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.430 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f145e426640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1458061b50 con 0x7f145810c860 2026-02-13T21:17:16.430 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f145e426640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f14580619d0 con 0x7f145810d990 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f1457fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 0x7f14581183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f1457fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 0x7f14581183d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52142/0 (socket says 10.20.193.12:52142) 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.423+0000 7f1457fff640 1 -- 10.20.193.12:0/802964348 learned_addr learned my addr 10.20.193.12:0/802964348 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f14577fe640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f145810d990 0x7f1458118a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f1457fff640 1 -- 10.20.193.12:0/802964348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f145810d990 msgr2=0x7f1458118a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f1457fff640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f145810d990 0x7f1458118a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f1457fff640 1 -- 10.20.193.12:0/802964348 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1458119630 con 0x7f145810c860 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f1457fff640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 0x7f14581183d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1444009900 tx=0x7f1444004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f14557fa640 1 -- 10.20.193.12:0/802964348 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1444046070 con 0x7f145810c860 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f145e426640 1 -- 10.20.193.12:0/802964348 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14581198c0 con 0x7f145810c860 2026-02-13T21:17:16.431 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f145e426640 1 -- 10.20.193.12:0/802964348 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1458119e70 con 0x7f145810c860 2026-02-13T21:17:16.432 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f14557fa640 1 -- 10.20.193.12:0/802964348 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f1444038900 con 0x7f145810c860 2026-02-13T21:17:16.432 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f14557fa640 1 -- 10.20.193.12:0/802964348 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1444050060 con 0x7f145810c860 2026-02-13T21:17:16.432 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc118250 con 0x7f48fc108950 2026-02-13T21:17:16.432 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.424+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc118d20 con 0x7f48fc108950 2026-02-13T21:17:16.433 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.425+0000 7f1432ffd640 1 -- 10.20.193.12:0/802964348 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1424005390 con 0x7f145810c860 2026-02-13T21:17:16.433 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.426+0000 7f14557fa640 1 -- 10.20.193.12:0/802964348 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f144404a8a0 con 0x7f145810c860 2026-02-13T21:17:16.433 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.427+0000 7f14577fe640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f145810d990 0x7f1458118a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:17:16.433 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.427+0000 7f14557fa640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f142c079430 0x7f142c099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.433 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.427+0000 7f14557fa640 1 -- 10.20.193.12:0/802964348 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f144403e070 con 0x7f145810c860 2026-02-13T21:17:16.434 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.427+0000 7f48e37fe640 1 -- 10.20.193.12:0/3806719735 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f48f0038470 con 0x7f48fc108950 2026-02-13T21:17:16.434 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.427+0000 7f48e37fe640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48d4079760 0x7f48d4099c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.434 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.427+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48fc14d960 con 0x7f48fc108950 2026-02-13T21:17:16.434 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.427+0000 7f48e37fe640 1 -- 10.20.193.12:0/3806719735 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f48f003e070 con 0x7f48fc108950 2026-02-13T21:17:16.434 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.428+0000 7f48f9d74640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48d4079760 0x7f48d4099c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.435 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.428+0000 7f14577fe640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f142c079430 0x7f142c099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.435 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.428+0000 7f14577fe640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f142c079430 0x7f142c099940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14480059a0 tx=0x7f1448005e10 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.435 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.431+0000 7f14557fa640 1 -- 10.20.193.12:0/802964348 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f144408e0d0 con 0x7f145810c860 2026-02-13T21:17:16.435 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.432+0000 7f48f9d74640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48d4079760 0x7f48d4099c70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48e40059a0 tx=0x7f48e4005930 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.437 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.434+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f39181b3920 con 0x7f391805e2d0 2026-02-13T21:17:16.438 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.435+0000 7f48e37fe640 1 -- 10.20.193.12:0/3806719735 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f48f008db00 con 0x7f48fc108950 2026-02-13T21:17:16.443 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.440+0000 7f38f7fff640 1 -- 10.20.193.12:0/2756038959 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v20)=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f3900090020 con 0x7f391805e2d0 2026-02-13T21:17:16.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.443+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38ec079500 msgr2=0x7f38ec099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.443+0000 7f391d217640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38ec079500 0x7f38ec099a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f390c005b60 tx=0x7f390c004400 comp rx=0 tx=0).stop 2026-02-13T21:17:16.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.444+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805e2d0 msgr2=0x7f39181b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.444+0000 7f391d217640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805e2d0 0x7f39181b22a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f390002f670 tx=0x7f3900005e40 comp rx=0 tx=0).stop 2026-02-13T21:17:16.447 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.444+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 shutdown_connections 2026-02-13T21:17:16.447 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.444+0000 7f391d217640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38ec079500 0x7f38ec099a10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.447 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.444+0000 7f391d217640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f391805e2d0 0x7f39181b22a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.447 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.444+0000 7f391d217640 1 --2- 10.20.193.12:0/2756038959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391805c4d0 0x7f39181b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.447 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.444+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 >> 10.20.193.12:0/2756038959 conn(0x7f3918059b40 msgr2=0x7f39181188b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.445+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 shutdown_connections 2026-02-13T21:17:16.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.448+0000 7f391d217640 1 -- 10.20.193.12:0/2756038959 wait complete. 2026-02-13T21:17:16.455 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.452+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f74680f5df0 con 0x7f746810b720 2026-02-13T21:17:16.459 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.457+0000 7f745effd640 1 -- 10.20.193.12:0/3746732229 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v21)=0 v21) ==== 119+0+0 (secure 0 0 0) 0x7f7450097b00 con 0x7f746810b720 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.465+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7444079430 msgr2=0x7f7444099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.465+0000 7f746fbce640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7444079430 0x7f7444099940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7458005b60 tx=0x7f7458004050 comp rx=0 tx=0).stop 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.465+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 msgr2=0x7f74680f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.465+0000 7f746fbce640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 0x7f74680f4580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f745000fba0 tx=0x7f7450003910 comp rx=0 tx=0).stop 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.465+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 shutdown_connections 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.465+0000 7f746fbce640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7444079430 0x7f7444099940 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.465+0000 7f746fbce640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f746810b720 0x7f74680f4580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.465+0000 7f746fbce640 1 --2- 10.20.193.12:0/3746732229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f746810a5f0 0x7f74680f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.469 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.466+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 >> 10.20.193.12:0/3746732229 conn(0x7f74680e7c90 msgr2=0x7f74680ea1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.470 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.466+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 shutdown_connections 2026-02-13T21:17:16.470 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.466+0000 7f746fbce640 1 -- 10.20.193.12:0/3746732229 wait complete. 2026-02-13T21:17:16.482 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.480+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f994c1074e0 con 0x7f994c109590 2026-02-13T21:17:16.486 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.484+0000 7f9950854640 1 -- 10.20.193.12:0/3423371769 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f993c068fe0 con 0x7f994c109590 2026-02-13T21:17:16.490 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.487+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9924079430 msgr2=0x7f9924099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.487+0000 7f9951856640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9924079430 0x7f9924099940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9934002400 tx=0x7f9934005930 comp rx=0 tx=0).stop 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.487+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c109590 msgr2=0x7f994c104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.487+0000 7f9951856640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c109590 0x7f994c104820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f993c009750 tx=0x7f993c00d4a0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.488+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 shutdown_connections 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.488+0000 7f9951856640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9924079430 0x7f9924099940 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.488+0000 7f9951856640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f994c109590 0x7f994c104820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.488+0000 7f9951856640 1 --2- 10.20.193.12:0/3423371769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f994c054da0 0x7f994c1041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.488+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 >> 10.20.193.12:0/3423371769 conn(0x7f994c0e6b40 msgr2=0x7f994c0fa460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.488+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 shutdown_connections 2026-02-13T21:17:16.491 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.488+0000 7f9951856640 1 -- 10.20.193.12:0/3423371769 wait complete. 2026-02-13T21:17:16.500 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.497+0000 7f165fbb7640 1 -- 10.20.193.12:0/3409590811 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810c860 msgr2=0x7f165810ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.500 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.497+0000 7f165fbb7640 1 --2- 10.20.193.12:0/3409590811 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810c860 0x7f165810ccd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1648005fd0 tx=0x7f164802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.500 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.497+0000 7f165fbb7640 1 -- 10.20.193.12:0/3409590811 shutdown_connections 2026-02-13T21:17:16.500 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.497+0000 7f165fbb7640 1 --2- 10.20.193.12:0/3409590811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810d990 0x7f165810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.501 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.497+0000 7f165fbb7640 1 --2- 10.20.193.12:0/3409590811 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810c860 0x7f165810ccd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.501 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.497+0000 7f165fbb7640 1 -- 10.20.193.12:0/3409590811 >> 10.20.193.12:0/3409590811 conn(0x7f16580e9f20 msgr2=0x7f165810a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.501 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.497+0000 7f165fbb7640 1 -- 10.20.193.12:0/3409590811 shutdown_connections 2026-02-13T21:17:16.501 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.497+0000 7f165fbb7640 1 -- 10.20.193.12:0/3409590811 wait complete. 2026-02-13T21:17:16.502 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.499+0000 7f165fbb7640 1 Processor -- start 2026-02-13T21:17:16.502 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.499+0000 7f165fbb7640 1 -- start start 2026-02-13T21:17:16.502 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.499+0000 7f165fbb7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 0x7f16580f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.502 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.499+0000 7f165fbb7640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810d990 0x7f16580f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.502 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.499+0000 7f165fbb7640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1658151690 con 0x7f165810d990 2026-02-13T21:17:16.502 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.499+0000 7f165d92c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 0x7f16580f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.503 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.499+0000 7f165d92c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 0x7f16580f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.12:46612/0 (socket says 10.20.193.12:46612) 2026-02-13T21:17:16.503 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.499+0000 7f165d92c640 1 -- 10.20.193.12:0/3742691238 learned_addr learned my addr 10.20.193.12:0/3742691238 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.503 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.500+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1658151510 con 0x7f165810c860 2026-02-13T21:17:16.503 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.500+0000 7f165d92c640 1 -- 10.20.193.12:0/3742691238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 msgr2=0x7f16580f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-13T21:17:16.503 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.500+0000 7f165d92c640 1 -- 10.20.193.12:0/3742691238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 msgr2=0x7f16580f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.503 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.500+0000 7f165d92c640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 0x7f16580f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.503 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.500+0000 7f165d92c640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 0x7f16580f6170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.504 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.501+0000 7f165d12b640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810d990 0x7f16580f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.505 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.502+0000 7f165d12b640 1 -- 10.20.193.12:0/3742691238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 msgr2=0x7f16580f6170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.505 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.502+0000 7f165d12b640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 0x7f16580f6170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.505 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.502+0000 7f165d12b640 1 -- 10.20.193.12:0/3742691238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16580f73d0 con 0x7f165810d990 2026-02-13T21:17:16.506 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7f165d12b640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810d990 0x7f16580f67e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f164c00d6a0 tx=0x7f164c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.506 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7f1646ffd640 1 -- 10.20.193.12:0/3742691238 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f164c014070 con 0x7f165810d990 2026-02-13T21:17:16.506 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16580f76c0 con 0x7f165810d990 2026-02-13T21:17:16.506 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16580f7cd0 con 0x7f165810d990 2026-02-13T21:17:16.507 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7fccb49c5640 1 -- 10.20.193.12:0/3324103788 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac132000 msgr2=0x7fccac152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.507 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7fccb49c5640 1 --2- 10.20.193.12:0/3324103788 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac132000 0x7fccac152420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005fd0 tx=0x7fcc980401c0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.507 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7fccb49c5640 1 -- 10.20.193.12:0/3324103788 shutdown_connections 2026-02-13T21:17:16.507 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7fccb49c5640 1 --2- 10.20.193.12:0/3324103788 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac132000 0x7fccac152420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.507 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7fccb49c5640 1 --2- 10.20.193.12:0/3324103788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccac1116a0 0x7fccac131ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.507 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7fccb49c5640 1 -- 10.20.193.12:0/3324103788 >> 10.20.193.12:0/3324103788 conn(0x7fccac061cd0 msgr2=0x7fccac0620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.508 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7f1646ffd640 1 -- 10.20.193.12:0/3742691238 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f164c0044a0 con 0x7f165810d990 2026-02-13T21:17:16.508 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.504+0000 7fccb49c5640 1 -- 10.20.193.12:0/3324103788 shutdown_connections 2026-02-13T21:17:16.508 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.503+0000 7f1646ffd640 1 -- 10.20.193.12:0/3742691238 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f164c01d060 con 0x7f165810d990 2026-02-13T21:17:16.509 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.504+0000 7fccb49c5640 1 -- 10.20.193.12:0/3324103788 wait complete. 2026-02-13T21:17:16.509 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.504+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165810dda0 con 0x7f165810d990 2026-02-13T21:17:16.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb49c5640 1 Processor -- start 2026-02-13T21:17:16.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb49c5640 1 -- start start 2026-02-13T21:17:16.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb49c5640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac1116a0 0x7fccac152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb49c5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccac132000 0x7fccac119130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb49c5640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fccac058770 con 0x7fccac1116a0 2026-02-13T21:17:16.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb49c5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fccac0585f0 con 0x7fccac132000 2026-02-13T21:17:16.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb273a640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac1116a0 0x7fccac152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb273a640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac1116a0 0x7fccac152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52176/0 (socket says 10.20.193.12:52176) 2026-02-13T21:17:16.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb273a640 1 -- 10.20.193.12:0/971163346 learned_addr learned my addr 10.20.193.12:0/971163346 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb1f39640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccac132000 0x7fccac119130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb273a640 1 -- 10.20.193.12:0/971163346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccac132000 msgr2=0x7fccac119130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb273a640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccac132000 0x7fccac119130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb273a640 1 -- 10.20.193.12:0/971163346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac1198a0 con 0x7fccac1116a0 2026-02-13T21:17:16.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.505+0000 7fccb273a640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac1116a0 0x7fccac152420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcca4005de0 tx=0x7fcca400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f7bcc10a9f0 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.512 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f5fb6401640 1 -- 10.20.193.12:0/564571453 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb0109480 msgr2=0x7f5fb01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.512 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f5fb6401640 1 --2- 10.20.193.12:0/564571453 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb0109480 0x7f5fb01098f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c005fd0 tx=0x7f5f9c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.512 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f5fb6401640 1 -- 10.20.193.12:0/564571453 shutdown_connections 2026-02-13T21:17:16.512 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f5fb6401640 1 --2- 10.20.193.12:0/564571453 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fb010a5b0 0x7f5fb010a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.512 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f5fb6401640 1 --2- 10.20.193.12:0/564571453 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb0109480 0x7f5fb01098f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.512 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f5fb6401640 1 -- 10.20.193.12:0/564571453 >> 10.20.193.12:0/564571453 conn(0x7f5fb00e6b40 msgr2=0x7f5fb0106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.513 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f1646ffd640 1 -- 10.20.193.12:0/3742691238 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f164c005020 con 0x7f165810d990 2026-02-13T21:17:16.513 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f1646ffd640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1634079360 0x7f1634099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.513 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.506+0000 7f1646ffd640 1 -- 10.20.193.12:0/3742691238 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f164c09b590 con 0x7f165810d990 2026-02-13T21:17:16.513 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.508+0000 7f165d92c640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1634079360 0x7f1634099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.514 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.508+0000 7f165d92c640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1634079360 0x7f1634099870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1648002fd0 tx=0x7f164803a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.515 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.509+0000 7f5fb6401640 1 -- 10.20.193.12:0/564571453 shutdown_connections 2026-02-13T21:17:16.515 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.509+0000 7f5fb6401640 1 -- 10.20.193.12:0/564571453 wait complete. 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.509+0000 7f5fb6401640 1 Processor -- start 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.509+0000 7f5fb6401640 1 -- start start 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5fb6401640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fb0109480 0x7f5fb00f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5fb6401640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb010a5b0 0x7f5fb00f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5fb6401640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb014d1d0 con 0x7f5fb010a5b0 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5fb6401640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb014d050 con 0x7f5fb0109480 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5faf7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb010a5b0 0x7f5fb00f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5faf7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb010a5b0 0x7f5fb00f3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52184/0 (socket says 10.20.193.12:52184) 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5faf7fe640 1 -- 10.20.193.12:0/4059984780 learned_addr learned my addr 10.20.193.12:0/4059984780 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.516 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5faf7fe640 1 -- 10.20.193.12:0/4059984780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fb0109480 msgr2=0x7f5fb00f2ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T21:17:16.517 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5faf7fe640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fb0109480 0x7f5fb00f2ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.517 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.510+0000 7f5faf7fe640 1 -- 10.20.193.12:0/4059984780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb00f4120 con 0x7f5fb010a5b0 2026-02-13T21:17:16.517 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.511+0000 7f5faf7fe640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb010a5b0 0x7f5fb00f3530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000b4a0 tx=0x7f5fa000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.517 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.511+0000 7f5fad7fa640 1 -- 10.20.193.12:0/4059984780 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5fa0004440 con 0x7f5fb010a5b0 2026-02-13T21:17:16.517 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.511+0000 7f5fb6401640 1 -- 10.20.193.12:0/4059984780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb00f4410 con 0x7f5fb010a5b0 2026-02-13T21:17:16.517 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.511+0000 7f5fb6401640 1 -- 10.20.193.12:0/4059984780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb00f4a20 con 0x7f5fb010a5b0 2026-02-13T21:17:16.517 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.511+0000 7fcc977fe640 1 -- 10.20.193.12:0/971163346 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcca4014070 con 0x7fccac1116a0 2026-02-13T21:17:16.518 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.511+0000 7f1646ffd640 1 -- 10.20.193.12:0/3742691238 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f164c0697b0 con 0x7f165810d990 2026-02-13T21:17:16.518 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.511+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccac119b90 con 0x7fccac1116a0 2026-02-13T21:17:16.518 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.511+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccac11a570 con 0x7fccac1116a0 2026-02-13T21:17:16.518 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.512+0000 7fcc977fe640 1 -- 10.20.193.12:0/971163346 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fcca4004d10 con 0x7fccac1116a0 2026-02-13T21:17:16.518 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.512+0000 7fcc977fe640 1 -- 10.20.193.12:0/971163346 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcca4005020 con 0x7fccac1116a0 2026-02-13T21:17:16.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.512+0000 7f5fad7fa640 1 -- 10.20.193.12:0/4059984780 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f5fa0015070 con 0x7f5fb010a5b0 2026-02-13T21:17:16.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.513+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccac0590d0 con 0x7fccac1116a0 2026-02-13T21:17:16.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.513+0000 7f5fad7fa640 1 -- 10.20.193.12:0/4059984780 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5fa0010a10 con 0x7f5fb010a5b0 2026-02-13T21:17:16.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.513+0000 7f5f82ffd640 1 -- 10.20.193.12:0/4059984780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f78005390 con 0x7f5fb010a5b0 2026-02-13T21:17:16.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7f5fad7fa640 1 -- 10.20.193.12:0/4059984780 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f5fa00026d0 con 0x7f5fb010a5b0 2026-02-13T21:17:16.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7fcc977fe640 1 -- 10.20.193.12:0/971163346 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7fcca40047a0 con 0x7fccac1116a0 2026-02-13T21:17:16.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7f5fad7fa640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f5f84079160 0x7f5f84099670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7f5fad7fa640 1 -- 10.20.193.12:0/4059984780 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f5fa009ae40 con 0x7f5fb010a5b0 2026-02-13T21:17:16.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.513+0000 7fb1cf7fe640 1 -- 10.20.193.12:0/107341209 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb1c8002d40 con 0x7fb1d8054a80 2026-02-13T21:17:16.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.513+0000 7fb1deadc640 1 -- 10.20.193.12:0/107341209 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 msgr2=0x7fb1d812b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.513+0000 7fb1deadc640 1 --2- 10.20.193.12:0/107341209 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 0x7fb1d812b250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8005fd0 tx=0x7fb1c802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7fb1deadc640 1 -- 10.20.193.12:0/107341209 shutdown_connections 2026-02-13T21:17:16.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7fb1deadc640 1 --2- 10.20.193.12:0/107341209 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 0x7fb1d814bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7fb1deadc640 1 --2- 10.20.193.12:0/107341209 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 0x7fb1d812b250 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7fb1deadc640 1 -- 10.20.193.12:0/107341209 >> 10.20.193.12:0/107341209 conn(0x7fb1d80e6b40 msgr2=0x7fb1d8106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7fb1deadc640 1 -- 10.20.193.12:0/107341209 shutdown_connections 2026-02-13T21:17:16.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7f5faffff640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f5f84079160 0x7f5f84099670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7f5faffff640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f5f84079160 0x7f5f84099670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009900 tx=0x7f5f9c0023c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.514+0000 7fb1deadc640 1 -- 10.20.193.12:0/107341209 wait complete. 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1deadc640 1 Processor -- start 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1deadc640 1 -- start start 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1deadc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 0x7fb1d8106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1deadc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 0x7fb1d811ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1deadc640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d814f3c0 con 0x7fb1d8054a80 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1deadc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d814f240 con 0x7fb1d812b790 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1dc851640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 0x7fb1d8106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1cffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 0x7fb1d811ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.524 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1cffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 0x7fb1d811ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.12:46676/0 (socket says 10.20.193.12:46676) 2026-02-13T21:17:16.524 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1cffff640 1 -- 10.20.193.12:0/2791811971 learned_addr learned my addr 10.20.193.12:0/2791811971 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.524 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1cffff640 1 -- 10.20.193.12:0/2791811971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 msgr2=0x7fb1d811ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T21:17:16.524 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1cffff640 1 -- 10.20.193.12:0/2791811971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 msgr2=0x7fb1d811ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.524 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1cffff640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 0x7fb1d811ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.524 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fb1cffff640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 0x7fb1d811ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.524 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fcc977fe640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc88079430 0x7fcc88099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.524 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fcc977fe640 1 -- 10.20.193.12:0/971163346 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fcca409b640 con 0x7fccac1116a0 2026-02-13T21:17:16.525 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fccb1f39640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc88079430 0x7fcc88099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.525 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.515+0000 7fccb1f39640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc88079430 0x7fcc88099940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005e40 tx=0x7fcc98005930 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.525 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.516+0000 7fb1dc851640 1 -- 10.20.193.12:0/2791811971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 msgr2=0x7fb1d811ff40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.525 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.516+0000 7fb1dc851640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 0x7fb1d811ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.525 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.516+0000 7fb1dc851640 1 -- 10.20.193.12:0/2791811971 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d8120610 con 0x7fb1d8054a80 2026-02-13T21:17:16.526 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.516+0000 7fb1dc851640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 0x7fb1d8106fd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8005fd0 tx=0x7fb1c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.526 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.520+0000 7fcc977fe640 1 -- 10.20.193.12:0/971163346 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fcca4069860 con 0x7fccac1116a0 2026-02-13T21:17:16.526 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.521+0000 7f5fad7fa640 1 -- 10.20.193.12:0/4059984780 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f5fa0069060 con 0x7f5fb010a5b0 2026-02-13T21:17:16.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.523+0000 7fb1cdffb640 1 -- 10.20.193.12:0/2791811971 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb1c8002d40 con 0x7fb1d8054a80 2026-02-13T21:17:16.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.523+0000 7fb1cdffb640 1 -- 10.20.193.12:0/2791811971 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fb1c8031070 con 0x7fb1d8054a80 2026-02-13T21:17:16.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.523+0000 7fb1cdffb640 1 -- 10.20.193.12:0/2791811971 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb1c8038690 con 0x7fb1d8054a80 2026-02-13T21:17:16.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.523+0000 7fb1deadc640 1 -- 10.20.193.12:0/2791811971 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d81208a0 con 0x7fb1d8054a80 2026-02-13T21:17:16.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.523+0000 7fb1deadc640 1 -- 10.20.193.12:0/2791811971 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d8121370 con 0x7fb1d8054a80 2026-02-13T21:17:16.528 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.524+0000 7fb1a77fe640 1 -- 10.20.193.12:0/2791811971 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb198005390 con 0x7fb1d8054a80 2026-02-13T21:17:16.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.525+0000 7f7babfff640 1 -- 10.20.193.12:0/4194597076 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f7bb406f8c0 con 0x7f7bcc10a5e0 2026-02-13T21:17:16.531 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.531 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.531 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7b98079280 msgr2=0x7f7b98099790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.531 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7b98079280 0x7f7b98099790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009900 tx=0x7f7bc003a040 comp rx=0 tx=0).stop 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc10a5e0 msgr2=0x7f7bcc1119d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc10a5e0 0x7f7bcc1119d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400d8d0 tx=0x7f7bb400dda0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 shutdown_connections 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7b98079280 0x7f7b98099790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7bcc10a5e0 0x7f7bcc1119d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 --2- 10.20.193.12:0/4194597076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bcc1094b0 0x7f7bcc111360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 >> 10.20.193.12:0/4194597076 conn(0x7f7bcc0e6b50 msgr2=0x7f7bcc107000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.528+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 shutdown_connections 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.529+0000 7f7bd14fa640 1 -- 10.20.193.12:0/4194597076 wait complete. 2026-02-13T21:17:16.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.530+0000 7fb1cdffb640 1 -- 10.20.193.12:0/2791811971 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7fb1c802faf0 con 0x7fb1d8054a80 2026-02-13T21:17:16.533 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.531+0000 7fb1cdffb640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb1b407d940 0x7fb1b409de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.533 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.531+0000 7fb1cffff640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb1b407d940 0x7fb1b409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.534 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.531+0000 7fb1cdffb640 1 -- 10.20.193.12:0/2791811971 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fb1c80c07c0 con 0x7fb1d8054a80 2026-02-13T21:17:16.534 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.531+0000 7fb1cffff640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb1b407d940 0x7fb1b409de50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0005fb0 tx=0x7fb1c0004420 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.538 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.535+0000 7fb1cdffb640 1 -- 10.20.193.12:0/2791811971 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fb1c803e040 con 0x7fb1d8054a80 2026-02-13T21:17:16.538 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.536+0000 7f6ec0dab640 1 -- 10.20.193.12:0/812177004 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc10a5e0 msgr2=0x7f6ebc10a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.536+0000 7f6ec0dab640 1 --2- 10.20.193.12:0/812177004 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc10a5e0 0x7f6ebc10a9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005fd0 tx=0x7f6ea402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.536+0000 7f6ec0dab640 1 -- 10.20.193.12:0/812177004 shutdown_connections 2026-02-13T21:17:16.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.536+0000 7f6ec0dab640 1 --2- 10.20.193.12:0/812177004 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc10a5e0 0x7f6ebc10a9f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.536+0000 7f6ec0dab640 1 --2- 10.20.193.12:0/812177004 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc1094b0 0x7f6ebc109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.536+0000 7f6ec0dab640 1 -- 10.20.193.12:0/812177004 >> 10.20.193.12:0/812177004 conn(0x7f6ebc0e6b50 msgr2=0x7f6ebc107000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.536+0000 7f6ec0dab640 1 -- 10.20.193.12:0/812177004 shutdown_connections 2026-02-13T21:17:16.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.536+0000 7f6ec0dab640 1 -- 10.20.193.12:0/812177004 wait complete. 2026-02-13T21:17:16.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6ec0dab640 1 Processor -- start 2026-02-13T21:17:16.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6ec0dab640 1 -- start start 2026-02-13T21:17:16.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6ec0dab640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc1094b0 0x7f6ebc0f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6ec0dab640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 0x7f6ebc0f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6ec0dab640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc14e2d0 con 0x7f6ebc1094b0 2026-02-13T21:17:16.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6ec0dab640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc14e150 con 0x7f6ebc10a5e0 2026-02-13T21:17:16.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eba575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc1094b0 0x7f6ebc0f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eba575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc1094b0 0x7f6ebc0f6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52204/0 (socket says 10.20.193.12:52204) 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eba575640 1 -- 10.20.193.12:0/543710346 learned_addr learned my addr 10.20.193.12:0/543710346 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eb9d74640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 0x7f6ebc0f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eb9d74640 1 -- 10.20.193.12:0/543710346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 msgr2=0x7f6ebc0f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eb9d74640 1 -- 10.20.193.12:0/543710346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 msgr2=0x7f6ebc0f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eb9d74640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 0x7f6ebc0f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eb9d74640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 0x7f6ebc0f68b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eba575640 1 -- 10.20.193.12:0/543710346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 msgr2=0x7f6ebc0f68b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eba575640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 0x7f6ebc0f68b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eba575640 1 -- 10.20.193.12:0/543710346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc0f74a0 con 0x7f6ebc1094b0 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.537+0000 7f6eba575640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc1094b0 0x7f6ebc0f6240 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000d8d0 tx=0x7f6eb000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.538+0000 7f6ea37fe640 1 -- 10.20.193.12:0/543710346 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6eb0014070 con 0x7f6ebc1094b0 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.538+0000 7f6ec0dab640 1 -- 10.20.193.12:0/543710346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc0f7790 con 0x7f6ebc1094b0 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.538+0000 7f6ea37fe640 1 -- 10.20.193.12:0/543710346 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f6eb000bcd0 con 0x7f6ebc1094b0 2026-02-13T21:17:16.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.538+0000 7f6ea37fe640 1 -- 10.20.193.12:0/543710346 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6eb0002cc0 con 0x7f6ebc1094b0 2026-02-13T21:17:16.543 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.538+0000 7f6ec0dab640 1 -- 10.20.193.12:0/543710346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc0f7da0 con 0x7f6ebc1094b0 2026-02-13T21:17:16.543 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.538+0000 7f6ea17fa640 1 -- 10.20.193.12:0/543710346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e84005390 con 0x7f6ebc1094b0 2026-02-13T21:17:16.543 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.539+0000 7f6ea37fe640 1 -- 10.20.193.12:0/543710346 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f6eb000b840 con 0x7f6ebc1094b0 2026-02-13T21:17:16.543 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.540+0000 7f6ea37fe640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e94079430 0x7f6e94099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:16.543 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.540+0000 7f6ea37fe640 1 -- 10.20.193.12:0/543710346 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f6eb009b640 con 0x7f6ebc1094b0 2026-02-13T21:17:16.544 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.540+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f0ab80f3cc0 con 0x7f0ab8109480 2026-02-13T21:17:16.544 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.541+0000 7f6eb9d74640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e94079430 0x7f6e94099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:16.544 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.541+0000 7f6eb9d74640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e94079430 0x7f6e94099940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005b60 tx=0x7f6ea403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:16.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.545+0000 7f6ea37fe640 1 -- 10.20.193.12:0/543710346 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f6eb0069860 con 0x7f6ebc1094b0 2026-02-13T21:17:16.549 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.549 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.549+0000 7f0ab4ff9640 1 -- 10.20.193.12:0/1192521333 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f0aa808e590 con 0x7f0ab8109480 2026-02-13T21:17:16.555 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0a8c079430 msgr2=0x7f0a8c099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.555 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0a8c079430 0x7f0a8c099940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4005ea0 tx=0x7f0aa4004050 comp rx=0 tx=0).stop 2026-02-13T21:17:16.555 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 msgr2=0x7f0ab80ea7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.555 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 0x7f0ab80ea7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8002e70 tx=0x7f0aa80042f0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.555 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 shutdown_connections 2026-02-13T21:17:16.555 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0a8c079430 0x7f0a8c099940 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.555 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab810a5b0 0x7f0ab80eae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.556 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 --2- 10.20.193.12:0/1192521333 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ab8109480 0x7f0ab80ea7a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.556 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 >> 10.20.193.12:0/1192521333 conn(0x7f0ab80e6b40 msgr2=0x7f0ab8053ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.556 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 shutdown_connections 2026-02-13T21:17:16.556 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.552+0000 7f0abdea7640 1 -- 10.20.193.12:0/1192521333 wait complete. 2026-02-13T21:17:16.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.576 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.574+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f05080fada0 con 0x7f050810a5f0 2026-02-13T21:17:16.579 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.577+0000 7f04f67fc640 1 -- 10.20.193.12:0/15224607 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v25)=0 v25) ==== 120+0+0 (secure 0 0 0) 0x7f04f808db50 con 0x7f050810a5f0 2026-02-13T21:17:16.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04e4079160 msgr2=0x7f04e4099670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04e4079160 0x7f04e4099670 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005fb0 tx=0x7f04fc004420 comp rx=0 tx=0).stop 2026-02-13T21:17:16.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 msgr2=0x7f05080f9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 0x7f05080f9540 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f04f8002400 tx=0x7f04f8005300 comp rx=0 tx=0).stop 2026-02-13T21:17:16.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 shutdown_connections 2026-02-13T21:17:16.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04e4079160 0x7f04e4099670 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810b720 0x7f05080f9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.584 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 --2- 10.20.193.12:0/15224607 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f050810a5f0 0x7f05080f9540 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.584 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 >> 10.20.193.12:0/15224607 conn(0x7f05080e7c90 msgr2=0x7f05081506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.584 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 shutdown_connections 2026-02-13T21:17:16.584 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.580+0000 7f050f3e0640 1 -- 10.20.193.12:0/15224607 wait complete. 2026-02-13T21:17:16.587 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.584+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f48fc119030 con 0x7f48fc108950 2026-02-13T21:17:16.590 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.587+0000 7f48e37fe640 1 -- 10.20.193.12:0/3806719735 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v26)=0 v26) ==== 111+0+0 (secure 0 0 0) 0x7f48f0092c00 con 0x7f48fc108950 2026-02-13T21:17:16.593 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48d4079760 msgr2=0x7f48d4099c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.593 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48d4079760 0x7f48d4099c70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48e40059a0 tx=0x7f48e4005930 comp rx=0 tx=0).stop 2026-02-13T21:17:16.593 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 msgr2=0x7f48fc106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.594 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 0x7f48fc106760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48f00092e0 tx=0x7f48f0004290 comp rx=0 tx=0).stop 2026-02-13T21:17:16.594 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 shutdown_connections 2026-02-13T21:17:16.594 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48d4079760 0x7f48d4099c70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.594 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48fc12bab0 0x7f48fc1178f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.594 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 --2- 10.20.193.12:0/3806719735 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48fc108950 0x7f48fc106760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.594 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 >> 10.20.193.12:0/3806719735 conn(0x7f48fc0e62b0 msgr2=0x7f48fc10e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.594 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 shutdown_connections 2026-02-13T21:17:16.594 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.591+0000 7f4900f6e640 1 -- 10.20.193.12:0/3806719735 wait complete. 2026-02-13T21:17:16.595 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.593+0000 7f1432ffd640 1 -- 10.20.193.12:0/802964348 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f1424005680 con 0x7f145810c860 2026-02-13T21:17:16.598 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.599 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.596+0000 7f14557fa640 1 -- 10.20.193.12:0/802964348 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v27)=0 v27) ==== 119+0+0 (secure 0 0 0) 0x7f14440931d0 con 0x7f145810c860 2026-02-13T21:17:16.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 -- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f142c079430 msgr2=0x7f142c099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f142c079430 0x7f142c099940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14480059a0 tx=0x7f1448005e10 comp rx=0 tx=0).stop 2026-02-13T21:17:16.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 -- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 msgr2=0x7f14581183d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 0x7f14581183d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1444009900 tx=0x7f1444004290 comp rx=0 tx=0).stop 2026-02-13T21:17:16.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 -- 10.20.193.12:0/802964348 shutdown_connections 2026-02-13T21:17:16.603 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f142c079430 0x7f142c099940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.603 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f145810d990 0x7f1458118a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.603 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 --2- 10.20.193.12:0/802964348 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f145810c860 0x7f14581183d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.603 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.599+0000 7f1432ffd640 1 -- 10.20.193.12:0/802964348 >> 10.20.193.12:0/802964348 conn(0x7f14580e9f20 msgr2=0x7f145810eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.603 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.600+0000 7f1432ffd640 1 -- 10.20.193.12:0/802964348 shutdown_connections 2026-02-13T21:17:16.603 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.600+0000 7f1432ffd640 1 -- 10.20.193.12:0/802964348 wait complete. 2026-02-13T21:17:16.626 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.645 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.646 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.647 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.644+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f16580f7f80 con 0x7f165810d990 2026-02-13T21:17:16.647 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.644+0000 7f1646ffd640 1 -- 10.20.193.12:0/3742691238 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v27)=0 v27) ==== 108+0+0 (secure 0 0 0) 0x7f164c06e8b0 con 0x7f165810d990 2026-02-13T21:17:16.650 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1634079360 msgr2=0x7f1634099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.650 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1634079360 0x7f1634099870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1648002fd0 tx=0x7f164803a040 comp rx=0 tx=0).stop 2026-02-13T21:17:16.650 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810d990 msgr2=0x7f16580f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.650 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810d990 0x7f16580f67e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f164c00d6a0 tx=0x7f164c00db70 comp rx=0 tx=0).stop 2026-02-13T21:17:16.650 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 shutdown_connections 2026-02-13T21:17:16.650 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1634079360 0x7f1634099870 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.650 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f165810d990 0x7f16580f67e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.650 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 --2- 10.20.193.12:0/3742691238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f165810c860 0x7f16580f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.651 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 >> 10.20.193.12:0/3742691238 conn(0x7f16580e9f20 msgr2=0x7f16580ec460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.651 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 shutdown_connections 2026-02-13T21:17:16.651 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.647+0000 7f165fbb7640 1 -- 10.20.193.12:0/3742691238 wait complete. 2026-02-13T21:17:16.654 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.652+0000 7f5f82ffd640 1 -- 10.20.193.12:0/4059984780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f5f780035d0 con 0x7f5fb010a5b0 2026-02-13T21:17:16.655 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.653+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fccac11b050 con 0x7fccac1116a0 2026-02-13T21:17:16.657 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.655+0000 7f5fad7fa640 1 -- 10.20.193.12:0/4059984780 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f5fa006e160 con 0x7f5fb010a5b0 2026-02-13T21:17:16.660 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.657+0000 7fcc977fe640 1 -- 10.20.193.12:0/971163346 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v29)=0 v29) ==== 125+0+0 (secure 0 0 0) 0x7fcca406e960 con 0x7fccac1116a0 2026-02-13T21:17:16.660 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 -- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f5f84079160 msgr2=0x7f5f84099670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f5f84079160 0x7f5f84099670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009900 tx=0x7f5f9c0023c0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 -- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb010a5b0 msgr2=0x7f5fb00f3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb010a5b0 0x7f5fb00f3530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000b4a0 tx=0x7f5fa000b970 comp rx=0 tx=0).stop 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 -- 10.20.193.12:0/4059984780 shutdown_connections 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f5f84079160 0x7f5f84099670 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5fb010a5b0 0x7f5fb00f3530 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 --2- 10.20.193.12:0/4059984780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fb0109480 0x7f5fb00f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 -- 10.20.193.12:0/4059984780 >> 10.20.193.12:0/4059984780 conn(0x7f5fb00e6b40 msgr2=0x7f5fb00e9180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 -- 10.20.193.12:0/4059984780 shutdown_connections 2026-02-13T21:17:16.661 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.658+0000 7f5f82ffd640 1 -- 10.20.193.12:0/4059984780 wait complete. 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc88079430 msgr2=0x7fcc88099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc88079430 0x7fcc88099940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005e40 tx=0x7fcc98005930 comp rx=0 tx=0).stop 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac1116a0 msgr2=0x7fccac152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac1116a0 0x7fccac152420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcca4005de0 tx=0x7fcca400dd70 comp rx=0 tx=0).stop 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 shutdown_connections 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc88079430 0x7fcc88099940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccac132000 0x7fccac119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 --2- 10.20.193.12:0/971163346 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fccac1116a0 0x7fccac152420 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 >> 10.20.193.12:0/971163346 conn(0x7fccac061cd0 msgr2=0x7fccac05c030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 shutdown_connections 2026-02-13T21:17:16.664 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.661+0000 7fccb49c5640 1 -- 10.20.193.12:0/971163346 wait complete. 2026-02-13T21:17:16.667 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.664+0000 7fb1a77fe640 1 -- 10.20.193.12:0/2791811971 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fb198005680 con 0x7fb1d8054a80 2026-02-13T21:17:16.667 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.665+0000 7fb1cdffb640 1 -- 10.20.193.12:0/2791811971 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v29)=0 v29) ==== 106+0+0 (secure 0 0 0) 0x7fb1c808e9e0 con 0x7fb1d8054a80 2026-02-13T21:17:16.670 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.667+0000 7fb1a77fe640 1 -- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb1b407d940 msgr2=0x7fb1b409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.670 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.667+0000 7fb1a77fe640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb1b407d940 0x7fb1b409de50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0005fb0 tx=0x7fb1c0004420 comp rx=0 tx=0).stop 2026-02-13T21:17:16.670 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.667+0000 7fb1a77fe640 1 -- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 msgr2=0x7fb1d8106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.667+0000 7fb1a77fe640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 0x7fb1d8106fd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8005fd0 tx=0x7fb1c80042f0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.667+0000 7fb1a77fe640 1 -- 10.20.193.12:0/2791811971 shutdown_connections 2026-02-13T21:17:16.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.667+0000 7fb1a77fe640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb1b407d940 0x7fb1b409de50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.667+0000 7fb1a77fe640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb1d812b790 0x7fb1d811ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.667+0000 7fb1a77fe640 1 --2- 10.20.193.12:0/2791811971 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb1d8054a80 0x7fb1d8106fd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.668+0000 7fb1a77fe640 1 -- 10.20.193.12:0/2791811971 >> 10.20.193.12:0/2791811971 conn(0x7fb1d80e6b40 msgr2=0x7fb1d8055d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.668+0000 7fb1a77fe640 1 -- 10.20.193.12:0/2791811971 shutdown_connections 2026-02-13T21:17:16.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.668+0000 7fb1a77fe640 1 -- 10.20.193.12:0/2791811971 wait complete. 2026-02-13T21:17:16.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.670+0000 7f6ea17fa640 1 -- 10.20.193.12:0/543710346 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f6e84005680 con 0x7f6ebc1094b0 2026-02-13T21:17:16.676 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.674+0000 7f6ea37fe640 1 -- 10.20.193.12:0/543710346 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f6eb006e960 con 0x7f6ebc1094b0 2026-02-13T21:17:16.679 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 -- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e94079430 msgr2=0x7f6e94099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e94079430 0x7f6e94099940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005b60 tx=0x7f6ea403a040 comp rx=0 tx=0).stop 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 -- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc1094b0 msgr2=0x7f6ebc0f6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc1094b0 0x7f6ebc0f6240 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000d8d0 tx=0x7f6eb000dda0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 -- 10.20.193.12:0/543710346 shutdown_connections 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e94079430 0x7f6e94099940 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ebc10a5e0 0x7f6ebc0f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 --2- 10.20.193.12:0/543710346 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6ebc1094b0 0x7f6ebc0f6240 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 -- 10.20.193.12:0/543710346 >> 10.20.193.12:0/543710346 conn(0x7f6ebc0e6b50 msgr2=0x7f6ebc054460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 -- 10.20.193.12:0/543710346 shutdown_connections 2026-02-13T21:17:16.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:16.677+0000 7f6ea17fa640 1 -- 10.20.193.12:0/543710346 wait complete. 2026-02-13T21:17:16.694 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.731 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.731 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.731 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3551db35-0921-11f1-800a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial012') 2026-02-13T21:17:16.740 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config dump 2026-02-13T21:17:16.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: Reconfiguring crash.trial012 (monmap changed)... 2026-02-13T21:17:16.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: Reconfiguring daemon crash.trial012 on trial012 2026-02-13T21:17:16.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: Reconfiguring alertmanager.trial012 deps ['mgr.trial012.zqhrrq', 'secure_monitoring_stack:False'] -> ['alertmanager.trial012', 'mgr.trial012.zqhrrq', 'mgr.trial090.qsdrej', 'secure_monitoring_stack:False'] (diff {'mgr.trial090.qsdrej', 'alertmanager.trial012'}) 2026-02-13T21:17:16.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: Reconfiguring daemon alertmanager.trial012 on trial012 2026-02-13T21:17:16.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2996157467' entity='client.admin' 2026-02-13T21:17:16.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3325956254' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3319118908' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1175194810' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2352138676' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/4071454974' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1833166071' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2938480853' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1871758855' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2756038959' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3746732229' entity='client.admin' 2026-02-13T21:17:16.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3423371769' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/4194597076' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1192521333' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/15224607' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3806719735' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/802964348' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/4059984780' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/971163346' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/543710346' entity='client.admin' 2026-02-13T21:17:16.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:16 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:17:16.898 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:17.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.004+0000 7f0ee7e77640 1 -- 10.20.193.12:0/4202792772 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 msgr2=0x7f0ee010ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:17.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.004+0000 7f0ee7e77640 1 --2- 10.20.193.12:0/4202792772 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 0x7f0ee010ddc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4005fd0 tx=0x7f0ed402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:17.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.004+0000 7f0ee7e77640 1 -- 10.20.193.12:0/4202792772 shutdown_connections 2026-02-13T21:17:17.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.004+0000 7f0ee7e77640 1 --2- 10.20.193.12:0/4202792772 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 0x7f0ee010ddc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:17.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.004+0000 7f0ee7e77640 1 --2- 10.20.193.12:0/4202792772 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ee010c880 0x7f0ee010ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:17.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.004+0000 7f0ee7e77640 1 -- 10.20.193.12:0/4202792772 >> 10.20.193.12:0/4202792772 conn(0x7f0ee00e9f40 msgr2=0x7f0ee010a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:17.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.004+0000 7f0ee7e77640 1 -- 10.20.193.12:0/4202792772 shutdown_connections 2026-02-13T21:17:17.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.004+0000 7f0ee7e77640 1 -- 10.20.193.12:0/4202792772 wait complete. 2026-02-13T21:17:17.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee7e77640 1 Processor -- start 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee7e77640 1 -- start start 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee7e77640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ee010c880 0x7f0ee00f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee7e77640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 0x7f0ee00f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee7e77640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee01516a0 con 0x7f0ee010d9b0 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee7e77640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee0151520 con 0x7f0ee010c880 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee53eb640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 0x7f0ee00f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee53eb640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 0x7f0ee00f6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:52226/0 (socket says 10.20.193.12:52226) 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee53eb640 1 -- 10.20.193.12:0/2779613238 learned_addr learned my addr 10.20.193.12:0/2779613238 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee5bec640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ee010c880 0x7f0ee00f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee53eb640 1 -- 10.20.193.12:0/2779613238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ee010c880 msgr2=0x7f0ee00f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee53eb640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ee010c880 0x7f0ee00f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:17.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee53eb640 1 -- 10.20.193.12:0/2779613238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee00f7430 con 0x7f0ee010d9b0 2026-02-13T21:17:17.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee53eb640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 0x7f0ee00f6840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4005b60 tx=0x7f0ed4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:17.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0eceffd640 1 -- 10.20.193.12:0/2779613238 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0ed4046070 con 0x7f0ee010d9b0 2026-02-13T21:17:17.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0eceffd640 1 -- 10.20.193.12:0/2779613238 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f0ed4038900 con 0x7f0ee010d9b0 2026-02-13T21:17:17.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0eceffd640 1 -- 10.20.193.12:0/2779613238 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0ed4041830 con 0x7f0ee010d9b0 2026-02-13T21:17:17.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.005+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee00f76c0 con 0x7f0ee010d9b0 2026-02-13T21:17:17.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.006+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee00f7c40 con 0x7f0ee010d9b0 2026-02-13T21:17:17.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.006+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee010ccf0 con 0x7f0ee010d9b0 2026-02-13T21:17:17.012 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.007+0000 7f0eceffd640 1 -- 10.20.193.12:0/2779613238 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f0ed4038470 con 0x7f0ee010d9b0 2026-02-13T21:17:17.012 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.007+0000 7f0eceffd640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0ebc079360 0x7f0ebc099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:17.012 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.007+0000 7f0eceffd640 1 -- 10.20.193.12:0/2779613238 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f0ed403e070 con 0x7f0ee010d9b0 2026-02-13T21:17:17.012 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.007+0000 7f0ee5bec640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0ebc079360 0x7f0ebc099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:17.012 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.008+0000 7f0ee5bec640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0ebc079360 0x7f0ebc099870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0004770 tx=0x7f0ed0005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:17.013 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.010+0000 7f0eceffd640 1 -- 10.20.193.12:0/2779613238 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f0ed4050080 con 0x7f0ee010d9b0 2026-02-13T21:17:17.121 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.118+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f0ee00eee30 con 0x7f0ee010d9b0 2026-02-13T21:17:17.122 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.119+0000 7f0eceffd640 1 -- 10.20.193.12:0/2779613238 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) ==== 59+0+16198 (secure 0 0 0) 0x7f0ed408e640 con 0x7f0ee010d9b0 2026-02-13T21:17:17.122 INFO:teuthology.orchestra.run.trial012.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global dev auth_debug true 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 * 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global basic log_to_file true 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global basic log_to_journald false 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global basic log_to_stderr false 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_allow_pool_delete true 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T21:17:17.123 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global dev ms_die_on_bug true 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global dev ms_die_on_old_message true 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T21:17:17.124 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced debug_mon 20/20 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced debug_ms 1/1 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced debug_paxos 20/20 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T21:17:17.125 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced client_mount_timeout 30 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced debug_client 20/20 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced debug_mgr 20/20 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced debug_ms 1/1 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced mgr/dashboard/GRAFANA_API_SSL_VERIFY false * 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-13T21:17:17.126 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd dev bdev_debug_aio true 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced debug_ms 1/1 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced debug_osd 20/20 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd dev osd_debug_op_order true 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd dev osd_debug_shutdown true 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T21:17:17.127 INFO:teuthology.orchestra.run.trial012.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T21:17:17.128 INFO:teuthology.orchestra.run.trial012.stdout:mds advanced debug_mds 20/20 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds advanced debug_ms 2/2 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds dev mds_debug_frag true 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds dev mds_debug_scatterstat true 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds dev mds_verify_scatter true 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:client advanced client_mount_timeout 600 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:client advanced debug_client 20/20 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:client advanced debug_ms 1/1 2026-02-13T21:17:17.129 INFO:teuthology.orchestra.run.trial012.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T21:17:17.130 INFO:teuthology.orchestra.run.trial012.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T21:17:17.130 INFO:teuthology.orchestra.run.trial012.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T21:17:17.130 INFO:teuthology.orchestra.run.trial012.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T21:17:17.130 INFO:teuthology.orchestra.run.trial012.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T21:17:17.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.121+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0ebc079360 msgr2=0x7f0ebc099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:17.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0ebc079360 0x7f0ebc099870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0004770 tx=0x7f0ed0005f30 comp rx=0 tx=0).stop 2026-02-13T21:17:17.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 msgr2=0x7f0ee00f6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:17.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 0x7f0ee00f6840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4005b60 tx=0x7f0ed4004290 comp rx=0 tx=0).stop 2026-02-13T21:17:17.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 shutdown_connections 2026-02-13T21:17:17.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0ebc079360 0x7f0ebc099870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:17.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ee010d9b0 0x7f0ee00f6840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:17.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 --2- 10.20.193.12:0/2779613238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ee010c880 0x7f0ee00f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:17.132 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 >> 10.20.193.12:0/2779613238 conn(0x7f0ee00e9f40 msgr2=0x7f0ee00ec4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:17.132 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 shutdown_connections 2026-02-13T21:17:17.132 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:17.122+0000 7f0ee7e77640 1 -- 10.20.193.12:0/2779613238 wait complete. 2026-02-13T21:17:17.165 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T21:17:17.165 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:17:17.165 DEBUG:teuthology.orchestra.run.trial012:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T21:17:17.184 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T21:17:17.184 DEBUG:teuthology.orchestra.run.trial012:> stat /dev/vg_nvme/lv_1 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout:Access: 2026-02-13 21:16:57.603359072 +0000 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout:Modify: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout:Change: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.241 INFO:teuthology.orchestra.run.trial012.stdout: Birth: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.242 DEBUG:teuthology.orchestra.run.trial012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T21:17:17.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: Reconfiguring crash.trial012 (monmap changed)... 2026-02-13T21:17:17.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: Reconfiguring daemon crash.trial012 on trial012 2026-02-13T21:17:17.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: Reconfiguring alertmanager.trial012 deps ['mgr.trial012.zqhrrq', 'secure_monitoring_stack:False'] -> ['alertmanager.trial012', 'mgr.trial012.zqhrrq', 'mgr.trial090.qsdrej', 'secure_monitoring_stack:False'] (diff {'mgr.trial090.qsdrej', 'alertmanager.trial012'}) 2026-02-13T21:17:17.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: Reconfiguring daemon alertmanager.trial012 on trial012 2026-02-13T21:17:17.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2996157467' entity='client.admin' 2026-02-13T21:17:17.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3325956254' entity='client.admin' 2026-02-13T21:17:17.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3319118908' entity='client.admin' 2026-02-13T21:17:17.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1175194810' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2352138676' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/4071454974' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1833166071' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2938480853' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1871758855' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2756038959' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3746732229' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3423371769' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/4194597076' entity='client.admin' 2026-02-13T21:17:17.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1192521333' entity='client.admin' 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/15224607' entity='client.admin' 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3806719735' entity='client.admin' 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/802964348' entity='client.admin' 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/4059984780' entity='client.admin' 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/971163346' entity='client.admin' 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/543710346' entity='client.admin' 2026-02-13T21:17:17.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:16 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:17:17.306 INFO:teuthology.orchestra.run.trial012.stderr:1+0 records in 2026-02-13T21:17:17.306 INFO:teuthology.orchestra.run.trial012.stderr:1+0 records out 2026-02-13T21:17:17.306 INFO:teuthology.orchestra.run.trial012.stderr:512 bytes copied, 0.000168082 s, 3.0 MB/s 2026-02-13T21:17:17.308 DEBUG:teuthology.orchestra.run.trial012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T21:17:17.367 DEBUG:teuthology.orchestra.run.trial012:> stat /dev/vg_nvme/lv_2 2026-02-13T21:17:17.422 INFO:teuthology.orchestra.run.trial012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T21:17:17.422 INFO:teuthology.orchestra.run.trial012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T21:17:17.423 INFO:teuthology.orchestra.run.trial012.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-13T21:17:17.423 INFO:teuthology.orchestra.run.trial012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T21:17:17.423 INFO:teuthology.orchestra.run.trial012.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T21:17:17.423 INFO:teuthology.orchestra.run.trial012.stdout:Access: 2026-02-13 21:16:57.604359056 +0000 2026-02-13T21:17:17.423 INFO:teuthology.orchestra.run.trial012.stdout:Modify: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.423 INFO:teuthology.orchestra.run.trial012.stdout:Change: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.423 INFO:teuthology.orchestra.run.trial012.stdout: Birth: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.423 DEBUG:teuthology.orchestra.run.trial012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T21:17:17.488 INFO:teuthology.orchestra.run.trial012.stderr:1+0 records in 2026-02-13T21:17:17.488 INFO:teuthology.orchestra.run.trial012.stderr:1+0 records out 2026-02-13T21:17:17.488 INFO:teuthology.orchestra.run.trial012.stderr:512 bytes copied, 0.000162312 s, 3.2 MB/s 2026-02-13T21:17:17.489 DEBUG:teuthology.orchestra.run.trial012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T21:17:17.547 DEBUG:teuthology.orchestra.run.trial012:> stat /dev/vg_nvme/lv_3 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout:Access: 2026-02-13 21:16:57.604359056 +0000 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout:Modify: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout:Change: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.604 INFO:teuthology.orchestra.run.trial012.stdout: Birth: 2026-02-13 21:14:53.523425930 +0000 2026-02-13T21:17:17.605 DEBUG:teuthology.orchestra.run.trial012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T21:17:17.667 INFO:teuthology.orchestra.run.trial012.stderr:1+0 records in 2026-02-13T21:17:17.668 INFO:teuthology.orchestra.run.trial012.stderr:1+0 records out 2026-02-13T21:17:17.668 INFO:teuthology.orchestra.run.trial012.stderr:512 bytes copied, 0.000238373 s, 2.1 MB/s 2026-02-13T21:17:17.670 DEBUG:teuthology.orchestra.run.trial012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T21:17:17.729 DEBUG:teuthology.orchestra.run.trial012:> stat /dev/vg_nvme/lv_4 2026-02-13T21:17:17.786 INFO:teuthology.orchestra.run.trial012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T21:17:17.786 INFO:teuthology.orchestra.run.trial012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T21:17:17.787 INFO:teuthology.orchestra.run.trial012.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-13T21:17:17.787 INFO:teuthology.orchestra.run.trial012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T21:17:17.787 INFO:teuthology.orchestra.run.trial012.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T21:17:17.787 INFO:teuthology.orchestra.run.trial012.stdout:Access: 2026-02-13 21:16:57.604359056 +0000 2026-02-13T21:17:17.787 INFO:teuthology.orchestra.run.trial012.stdout:Modify: 2026-02-13 21:14:53.524425913 +0000 2026-02-13T21:17:17.787 INFO:teuthology.orchestra.run.trial012.stdout:Change: 2026-02-13 21:14:53.524425913 +0000 2026-02-13T21:17:17.787 INFO:teuthology.orchestra.run.trial012.stdout: Birth: 2026-02-13 21:14:53.524425913 +0000 2026-02-13T21:17:17.788 DEBUG:teuthology.orchestra.run.trial012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T21:17:17.851 INFO:teuthology.orchestra.run.trial012.stderr:1+0 records in 2026-02-13T21:17:17.851 INFO:teuthology.orchestra.run.trial012.stderr:1+0 records out 2026-02-13T21:17:17.851 INFO:teuthology.orchestra.run.trial012.stderr:512 bytes copied, 0.000225078 s, 2.3 MB/s 2026-02-13T21:17:17.852 DEBUG:teuthology.orchestra.run.trial012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T21:17:17.912 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:17:17.912 DEBUG:teuthology.orchestra.run.trial090:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T21:17:17.930 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T21:17:17.930 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_1 2026-02-13T21:17:17.951 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:17 trial012 ceph-mon[37926]: Reconfiguring grafana.trial012 deps ['secure_monitoring_stack:False'] -> ['prometheus.trial012', 'secure_monitoring_stack:False'] (diff {'prometheus.trial012'}) 2026-02-13T21:17:17.951 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:17 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-13T21:17:17.951 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:17 trial012 ceph-mon[37926]: Reconfiguring daemon grafana.trial012 on trial012 2026-02-13T21:17:17.951 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:17 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:17.951 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:17 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2779613238' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T21:17:17.951 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:17.951 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:17.951 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:17.988 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T21:17:17.988 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T21:17:17.988 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-13T21:17:17.988 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T21:17:17.988 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T21:17:17.988 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-13 21:17:08.320921718 +0000 2026-02-13T21:17:17.988 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-13 21:14:47.066225423 +0000 2026-02-13T21:17:17.988 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-13 21:14:47.066225423 +0000 2026-02-13T21:17:17.989 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-13 21:14:47.066225423 +0000 2026-02-13T21:17:17.989 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T21:17:18.050 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-13T21:17:18.050 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-13T21:17:18.050 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.00015084 s, 3.4 MB/s 2026-02-13T21:17:18.051 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T21:17:18.109 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_2 2026-02-13T21:17:18.165 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T21:17:18.165 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T21:17:18.165 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-13T21:17:18.166 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T21:17:18.166 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T21:17:18.166 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-13 21:17:08.320921718 +0000 2026-02-13T21:17:18.166 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-13 21:14:47.065225441 +0000 2026-02-13T21:17:18.166 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-13 21:14:47.065225441 +0000 2026-02-13T21:17:18.166 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-13 21:14:47.065225441 +0000 2026-02-13T21:17:18.166 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T21:17:18.226 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:17 trial090 ceph-mon[42877]: Reconfiguring grafana.trial012 deps ['secure_monitoring_stack:False'] -> ['prometheus.trial012', 'secure_monitoring_stack:False'] (diff {'prometheus.trial012'}) 2026-02-13T21:17:18.226 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:17 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-13T21:17:18.227 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:17 trial090 ceph-mon[42877]: Reconfiguring daemon grafana.trial012 on trial012 2026-02-13T21:17:18.227 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:17 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:18.227 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:17 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2779613238' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T21:17:18.227 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:18.227 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:18.227 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:18.228 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-13T21:17:18.228 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-13T21:17:18.228 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000141012 s, 3.6 MB/s 2026-02-13T21:17:18.230 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T21:17:18.287 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_3 2026-02-13T21:17:18.344 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T21:17:18.344 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T21:17:18.344 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-13T21:17:18.344 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T21:17:18.344 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T21:17:18.344 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-13 21:17:08.320921718 +0000 2026-02-13T21:17:18.344 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-13 21:14:47.065225441 +0000 2026-02-13T21:17:18.345 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-13 21:14:47.065225441 +0000 2026-02-13T21:17:18.345 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-13 21:14:47.065225441 +0000 2026-02-13T21:17:18.345 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T21:17:18.407 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-13T21:17:18.407 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-13T21:17:18.407 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000229246 s, 2.2 MB/s 2026-02-13T21:17:18.409 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T21:17:18.468 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_4 2026-02-13T21:17:18.525 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T21:17:18.525 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T21:17:18.526 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-13T21:17:18.526 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T21:17:18.526 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T21:17:18.526 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-13 21:17:08.321921701 +0000 2026-02-13T21:17:18.526 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-13 21:14:47.064225458 +0000 2026-02-13T21:17:18.526 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-13 21:14:47.064225458 +0000 2026-02-13T21:17:18.526 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-13 21:14:47.064225458 +0000 2026-02-13T21:17:18.527 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T21:17:18.592 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-13T21:17:18.593 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-13T21:17:18.593 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000219648 s, 2.3 MB/s 2026-02-13T21:17:18.594 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T21:17:18.654 INFO:tasks.cephadm:Deploying osd.0 on trial012 with /dev/vg_nvme/lv_4... 2026-02-13T21:17:18.655 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T21:17:18.779 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:19.038 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:19.038 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: Reconfiguring prometheus.trial012 deps ['8765', '9283', 'alertmanager', 'ceph-exporter.trial012', 'mgr.trial012.zqhrrq', 'node-exporter', 'secure_monitoring_stack:False'] -> ['8765', '9283', 'alertmanager', 'ceph-exporter.trial012', 'ceph-exporter.trial090', 'mgr.trial012.zqhrrq', 'node-exporter', 'secure_monitoring_stack:False'] (diff {'ceph-exporter.trial090'}) 2026-02-13T21:17:19.038 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: Reconfiguring daemon prometheus.trial012 on trial012 2026-02-13T21:17:19.038 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:19.038 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:19.039 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:19.039 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial090", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2026-02-13T21:17:19.039 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:19.039 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:19.039 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:19.039 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.trial090", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2026-02-13T21:17:19.039 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:18 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:19.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: Reconfiguring prometheus.trial012 deps ['8765', '9283', 'alertmanager', 'ceph-exporter.trial012', 'mgr.trial012.zqhrrq', 'node-exporter', 'secure_monitoring_stack:False'] -> ['8765', '9283', 'alertmanager', 'ceph-exporter.trial012', 'ceph-exporter.trial090', 'mgr.trial012.zqhrrq', 'node-exporter', 'secure_monitoring_stack:False'] (diff {'ceph-exporter.trial090'}) 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: Reconfiguring daemon prometheus.trial012 on trial012 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial090", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:19.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.trial090", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2026-02-13T21:17:19.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:18 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:19.261 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:17:19.280 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch daemon add osd trial012:vg_nvme/lv_4 --skip-validation 2026-02-13T21:17:19.400 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:19.538 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.533+0000 7fbf263a4640 1 -- 10.20.193.12:0/1990315665 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 msgr2=0x7fbf2010ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:19.538 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.533+0000 7fbf263a4640 1 --2- 10.20.193.12:0/1990315665 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 0x7fbf2010ca60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbf10005fd0 tx=0x7fbf1002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:19.538 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 -- 10.20.193.12:0/1990315665 shutdown_connections 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 --2- 10.20.193.12:0/1990315665 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf2010d720 0x7fbf2010db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 --2- 10.20.193.12:0/1990315665 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 0x7fbf2010ca60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 -- 10.20.193.12:0/1990315665 >> 10.20.193.12:0/1990315665 conn(0x7fbf200e9c90 msgr2=0x7fbf2010a140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 -- 10.20.193.12:0/1990315665 shutdown_connections 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 -- 10.20.193.12:0/1990315665 wait complete. 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 Processor -- start 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 -- start start 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 0x7fbf200f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf2010d720 0x7fbf200f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20151400 con 0x7fbf2010c5f0 2026-02-13T21:17:19.539 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf263a4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20151280 con 0x7fbf2010d720 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf253a2640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 0x7fbf200f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf253a2640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 0x7fbf200f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:40252/0 (socket says 10.20.193.12:40252) 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf253a2640 1 -- 10.20.193.12:0/3744507780 learned_addr learned my addr 10.20.193.12:0/3744507780 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf24ba1640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf2010d720 0x7fbf200f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf253a2640 1 -- 10.20.193.12:0/3744507780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf2010d720 msgr2=0x7fbf200f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf253a2640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf2010d720 0x7fbf200f65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.534+0000 7fbf253a2640 1 -- 10.20.193.12:0/3744507780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf200f71c0 con 0x7fbf2010c5f0 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.535+0000 7fbf253a2640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 0x7fbf200f5f60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf10005b60 tx=0x7fbf10004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.535+0000 7fbf0e7fc640 1 -- 10.20.193.12:0/3744507780 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf10046070 con 0x7fbf2010c5f0 2026-02-13T21:17:19.540 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.535+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf200f7450 con 0x7fbf2010c5f0 2026-02-13T21:17:19.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.535+0000 7fbf0e7fc640 1 -- 10.20.193.12:0/3744507780 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fbf10038900 con 0x7fbf2010c5f0 2026-02-13T21:17:19.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.535+0000 7fbf0e7fc640 1 -- 10.20.193.12:0/3744507780 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf10041830 con 0x7fbf2010c5f0 2026-02-13T21:17:19.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.535+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf200f79d0 con 0x7fbf2010c5f0 2026-02-13T21:17:19.541 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.535+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2010db30 con 0x7fbf2010c5f0 2026-02-13T21:17:19.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.536+0000 7fbf0e7fc640 1 -- 10.20.193.12:0/3744507780 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7fbf10038470 con 0x7fbf2010c5f0 2026-02-13T21:17:19.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.537+0000 7fbf0e7fc640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbefc079360 0x7fbefc099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:19.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.537+0000 7fbf24ba1640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbefc079360 0x7fbefc099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:19.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.537+0000 7fbf0e7fc640 1 -- 10.20.193.12:0/3744507780 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fbf1003e070 con 0x7fbf2010c5f0 2026-02-13T21:17:19.542 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.537+0000 7fbf24ba1640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbefc079360 0x7fbefc099870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf14004770 tx=0x7fbf14005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:19.543 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.539+0000 7fbf0e7fc640 1 -- 10.20.193.12:0/3744507780 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fbf10050020 con 0x7fbf2010c5f0 2026-02-13T21:17:19.653 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:19.651+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fbf200eee40 con 0x7fbefc079360 2026-02-13T21:17:20.082 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:20.082 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: Reconfiguring ceph-exporter.trial090 (monmap changed)... 2026-02-13T21:17:20.082 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: Reconfiguring daemon ceph-exporter.trial090 on trial090 2026-02-13T21:17:20.082 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: Reconfiguring crash.trial090 (monmap changed)... 2026-02-13T21:17:20.082 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: Reconfiguring daemon crash.trial090 on trial090 2026-02-13T21:17:20.082 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: Reconfiguring mgr.trial090.qsdrej (monmap changed)... 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mgr.trial090.qsdrej", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: Reconfiguring daemon mgr.trial090.qsdrej on trial090 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T21:17:20.083 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial012:9093"} : dispatch 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://trial012:3000"} : dispatch 2026-02-13T21:17:20.084 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://trial012:9095"} : dispatch 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:20.085 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:19 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:20.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:20.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: Reconfiguring ceph-exporter.trial090 (monmap changed)... 2026-02-13T21:17:20.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: Reconfiguring daemon ceph-exporter.trial090 on trial090 2026-02-13T21:17:20.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: Reconfiguring crash.trial090 (monmap changed)... 2026-02-13T21:17:20.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: Reconfiguring daemon crash.trial090 on trial090 2026-02-13T21:17:20.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: Reconfiguring mgr.trial090.qsdrej (monmap changed)... 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mgr.trial090.qsdrej", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: Reconfiguring daemon mgr.trial090.qsdrej on trial090 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial012:9093"} : dispatch 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://trial012:3000"} : dispatch 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://trial012:9095"} : dispatch 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:20.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:19 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:21.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: Reconfiguring mon.trial090 (monmap changed)... 2026-02-13T21:17:21.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: Reconfiguring daemon mon.trial090 on trial090 2026-02-13T21:17:21.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-13T21:17:21.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial012:9093"}]: dispatch 2026-02-13T21:17:21.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial012:3000"}]: dispatch 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial012:9095"}]: dispatch 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: Certificate for "grafana_cert (trial012)" is still valid for 1094 days. 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: osd.default does not exist. Creating it now. 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: Creating OSDs with service ID: default on trial012:['vg_nvme/lv_4'] 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: Marking host: trial012 for OSDSpec preview refresh. 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: Saving service osd.default spec with placement trial012 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3869140537' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de74b69e-730a-4162-a3cc-3daa616bf84d"} : dispatch 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3869140537' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de74b69e-730a-4162-a3cc-3daa616bf84d"}]': finished 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:21.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.129 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:21.129 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:21.129 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:21.129 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:20 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2794864564' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:21.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: Reconfiguring mon.trial090 (monmap changed)... 2026-02-13T21:17:21.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: Reconfiguring daemon mon.trial090 on trial090 2026-02-13T21:17:21.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-13T21:17:21.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial012:9093"}]: dispatch 2026-02-13T21:17:21.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial012:3000"}]: dispatch 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial012:9095"}]: dispatch 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: Certificate for "grafana_cert (trial012)" is still valid for 1094 days. 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: osd.default does not exist. Creating it now. 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: Creating OSDs with service ID: default on trial012:['vg_nvme/lv_4'] 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: Marking host: trial012 for OSDSpec preview refresh. 2026-02-13T21:17:21.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: Saving service osd.default spec with placement trial012 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3869140537' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de74b69e-730a-4162-a3cc-3daa616bf84d"} : dispatch 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3869140537' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de74b69e-730a-4162-a3cc-3daa616bf84d"}]': finished 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.275 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:21.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:21.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:21.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:21.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:21.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:21.276 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:20 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2794864564' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:21.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:21 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:22.271 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:21 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:23.081 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:22 trial012 ceph-mon[37926]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:23.081 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:22 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T21:17:23.081 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:22 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:23.081 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:22 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T21:17:23.081 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:22 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:23.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:22 trial090 ceph-mon[42877]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:23.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:22 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T21:17:23.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:22 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:23.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:22 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T21:17:23.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:22 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:24.124 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:23 trial012 ceph-mon[37926]: Deploying daemon osd.0 on trial012 2026-02-13T21:17:24.124 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:23 trial012 ceph-mon[37926]: Deploying daemon osd.0 on trial012 2026-02-13T21:17:24.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:23 trial090 ceph-mon[42877]: Deploying daemon osd.0 on trial012 2026-02-13T21:17:24.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:23 trial090 ceph-mon[42877]: Deploying daemon osd.0 on trial012 2026-02-13T21:17:24.994 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:24 trial012 ceph-mon[37926]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:24.995 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:24.995 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:25.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:24 trial090 ceph-mon[42877]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:25.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:25.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:27.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:26 trial012 ceph-mon[37926]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:27.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:26 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:27.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:26 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:27.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:26 trial090 ceph-mon[42877]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:27.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:26 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:27.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:26 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:27.273 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.270+0000 7fbf0e7fc640 1 -- 10.20.193.12:0/3744507780 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fbf200eee40 con 0x7fbefc079360 2026-02-13T21:17:27.273 INFO:teuthology.orchestra.run.trial012.stdout:Created osd(s) 0 on host 'trial012' 2026-02-13T21:17:27.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbefc079360 msgr2=0x7fbefc099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:27.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbefc079360 0x7fbefc099870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf14004770 tx=0x7fbf14005f30 comp rx=0 tx=0).stop 2026-02-13T21:17:27.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 msgr2=0x7fbf200f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:27.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 0x7fbf200f5f60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf10005b60 tx=0x7fbf10004290 comp rx=0 tx=0).stop 2026-02-13T21:17:27.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 shutdown_connections 2026-02-13T21:17:27.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbefc079360 0x7fbefc099870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:27.277 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf2010d720 0x7fbf200f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:27.277 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 --2- 10.20.193.12:0/3744507780 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf2010c5f0 0x7fbf200f5f60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:27.277 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 >> 10.20.193.12:0/3744507780 conn(0x7fbf200e9c90 msgr2=0x7fbf200ec2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:27.277 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 shutdown_connections 2026-02-13T21:17:27.277 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:27.272+0000 7fbf263a4640 1 -- 10.20.193.12:0/3744507780 wait complete. 2026-02-13T21:17:27.313 DEBUG:teuthology.orchestra.run.trial012:osd.0> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.0.service 2026-02-13T21:17:27.316 INFO:tasks.cephadm:Deploying osd.1 on trial012 with /dev/vg_nvme/lv_3... 2026-02-13T21:17:27.316 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T21:17:27.487 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:28.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:27 trial012 ceph-mon[37926]: from='osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T21:17:28.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:27 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:28.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:27 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:28.259 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:27 trial090 ceph-mon[42877]: from='osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T21:17:28.259 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:27 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:28.259 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:27 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:28.453 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:17:28.470 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch daemon add osd trial012:vg_nvme/lv_3 --skip-validation 2026-02-13T21:17:28.590 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:28.720 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.716+0000 7f63d0abf640 1 -- 10.20.193.12:0/3958443163 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 msgr2=0x7f63cc14bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:28.720 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.716+0000 7f63d0abf640 1 --2- 10.20.193.12:0/3958443163 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 0x7f63cc14bc50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f63b4005fd0 tx=0x7f63b402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:28.720 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.716+0000 7f63d0abf640 1 -- 10.20.193.12:0/3958443163 shutdown_connections 2026-02-13T21:17:28.720 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.716+0000 7f63d0abf640 1 --2- 10.20.193.12:0/3958443163 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 0x7f63cc14bc50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:28.720 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.716+0000 7f63d0abf640 1 --2- 10.20.193.12:0/3958443163 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63cc054a80 0x7f63cc12b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:28.720 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.716+0000 7f63d0abf640 1 -- 10.20.193.12:0/3958443163 >> 10.20.193.12:0/3958443163 conn(0x7f63cc0e6b40 msgr2=0x7f63cc106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:28.720 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.716+0000 7f63d0abf640 1 -- 10.20.193.12:0/3958443163 shutdown_connections 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.716+0000 7f63d0abf640 1 -- 10.20.193.12:0/3958443163 wait complete. 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63d0abf640 1 Processor -- start 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63d0abf640 1 -- start start 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63d0abf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63cc054a80 0x7f63cc106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63d0abf640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 0x7f63cc1175c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63d0abf640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc14f3d0 con 0x7f63cc12b790 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63d0abf640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc14f250 con 0x7f63cc054a80 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63c9d74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 0x7f63cc1175c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63c9d74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 0x7f63cc1175c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:40368/0 (socket says 10.20.193.12:40368) 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63c9d74640 1 -- 10.20.193.12:0/2652704089 learned_addr learned my addr 10.20.193.12:0/2652704089 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63ca575640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63cc054a80 0x7f63cc106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63c9d74640 1 -- 10.20.193.12:0/2652704089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63cc054a80 msgr2=0x7f63cc106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63c9d74640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63cc054a80 0x7f63cc106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63c9d74640 1 -- 10.20.193.12:0/2652704089 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc117c90 con 0x7f63cc12b790 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63c9d74640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 0x7f63cc1175c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63b4005b60 tx=0x7f63b4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.717+0000 7f63b37fe640 1 -- 10.20.193.12:0/2652704089 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f63b4046070 con 0x7f63cc12b790 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.718+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc117f20 con 0x7f63cc12b790 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.718+0000 7f63b37fe640 1 -- 10.20.193.12:0/2652704089 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f63b4038900 con 0x7f63cc12b790 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.718+0000 7f63b37fe640 1 -- 10.20.193.12:0/2652704089 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f63b4041830 con 0x7f63cc12b790 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.718+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc1189f0 con 0x7f63cc12b790 2026-02-13T21:17:28.721 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.718+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc119460 con 0x7f63cc12b790 2026-02-13T21:17:28.722 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.719+0000 7f63b37fe640 1 -- 10.20.193.12:0/2652704089 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f63b4038470 con 0x7f63cc12b790 2026-02-13T21:17:28.723 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.720+0000 7f63b37fe640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f63a4079430 0x7f63a4099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:28.723 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.720+0000 7f63b37fe640 1 -- 10.20.193.12:0/2652704089 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1571+0+0 (secure 0 0 0) 0x7f63b403e070 con 0x7f63cc12b790 2026-02-13T21:17:28.723 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.720+0000 7f63ca575640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f63a4079430 0x7f63a4099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:28.723 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.720+0000 7f63ca575640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f63a4079430 0x7f63a4099940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f63c0004770 tx=0x7f63c0005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:28.725 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.722+0000 7f63b37fe640 1 -- 10.20.193.12:0/2652704089 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f63b4050080 con 0x7f63cc12b790 2026-02-13T21:17:28.841 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:28.838+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f63cc110a30 con 0x7f63a4079430 2026-02-13T21:17:29.001 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:28 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0[59144]: 2026-02-13T21:17:28.874+0000 7f8f930c2640 -1 osd.0 0 waiting for initial osdmap 2026-02-13T21:17:29.001 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:28 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0[59144]: 2026-02-13T21:17:28.876+0000 7f8f8e6aa640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T21:17:29.001 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:29.001 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T21:17:29.001 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T21:17:29.001 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial012", "root=default"]} : dispatch 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:29.002 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:28 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial012", "root=default"]} : dispatch 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:29.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:28 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:29.915 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:29.915 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: osd.default does not exist. Creating it now. 2026-02-13T21:17:29.915 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: Creating OSDs with service ID: default on trial012:['vg_nvme/lv_3'] 2026-02-13T21:17:29.915 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: Marking host: trial012 for OSDSpec preview refresh. 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: Saving service osd.default spec with placement trial012 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial012", "root=default"]}]': finished 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: osdmap e8: 1 total, 0 up, 1 in 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/44611230' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6118d6e3-09c9-4db8-b217-1c3327e2ea30"} : dispatch 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/44611230' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6118d6e3-09c9-4db8-b217-1c3327e2ea30"}]': finished 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] boot 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T21:17:29.916 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:29.917 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:29 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:30.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:30.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: osd.default does not exist. Creating it now. 2026-02-13T21:17:30.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: Creating OSDs with service ID: default on trial012:['vg_nvme/lv_3'] 2026-02-13T21:17:30.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: Marking host: trial012 for OSDSpec preview refresh. 2026-02-13T21:17:30.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: Saving service osd.default spec with placement trial012 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial012", "root=default"]}]': finished 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: osdmap e8: 1 total, 0 up, 1 in 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/44611230' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6118d6e3-09c9-4db8-b217-1c3327e2ea30"} : dispatch 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/44611230' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6118d6e3-09c9-4db8-b217-1c3327e2ea30"}]': finished 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: osd.0 [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] boot 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T21:17:30.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T21:17:30.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:29 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:31.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:30 trial012 ceph-mon[37926]: purged_snaps scrub starts 2026-02-13T21:17:31.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:30 trial012 ceph-mon[37926]: purged_snaps scrub ok 2026-02-13T21:17:31.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:30 trial012 ceph-mon[37926]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:31.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:30 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1918439401' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:31.271 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:30 trial090 ceph-mon[42877]: purged_snaps scrub starts 2026-02-13T21:17:31.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:30 trial090 ceph-mon[42877]: purged_snaps scrub ok 2026-02-13T21:17:31.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:30 trial090 ceph-mon[42877]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T21:17:31.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:30 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1918439401' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:31.893 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T21:17:31.893 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:31.893 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:31.893 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:31.893 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:31.893 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:31.893 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:31.893 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:31.894 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:31 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:17:32.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T21:17:32.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:32.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:32.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:32.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:32.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:32.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:31 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:17:33.217 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:32 trial012 ceph-mon[37926]: Detected new or changed devices on trial012 2026-02-13T21:17:33.217 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:32 trial012 ceph-mon[37926]: Adjusting osd_memory_target on trial012 to 78799M 2026-02-13T21:17:33.217 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:32 trial012 ceph-mon[37926]: Deploying daemon osd.1 on trial012 2026-02-13T21:17:33.217 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:32 trial012 ceph-mon[37926]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T21:17:33.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:32 trial090 ceph-mon[42877]: Detected new or changed devices on trial012 2026-02-13T21:17:33.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:32 trial090 ceph-mon[42877]: Adjusting osd_memory_target on trial012 to 78799M 2026-02-13T21:17:33.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:32 trial090 ceph-mon[42877]: Deploying daemon osd.1 on trial012 2026-02-13T21:17:33.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:32 trial090 ceph-mon[42877]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T21:17:34.598 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.594+0000 7f63b37fe640 1 -- 10.20.193.12:0/2652704089 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f63cc110a30 con 0x7f63a4079430 2026-02-13T21:17:34.599 INFO:teuthology.orchestra.run.trial012.stdout:Created osd(s) 1 on host 'trial012' 2026-02-13T21:17:34.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f63a4079430 msgr2=0x7f63a4099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:34.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f63a4079430 0x7f63a4099940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f63c0004770 tx=0x7f63c0005f30 comp rx=0 tx=0).stop 2026-02-13T21:17:34.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 msgr2=0x7f63cc1175c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:34.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 0x7f63cc1175c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63b4005b60 tx=0x7f63b4004290 comp rx=0 tx=0).stop 2026-02-13T21:17:34.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 shutdown_connections 2026-02-13T21:17:34.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f63a4079430 0x7f63a4099940 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:34.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f63cc12b790 0x7f63cc1175c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:34.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 --2- 10.20.193.12:0/2652704089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63cc054a80 0x7f63cc106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:34.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 >> 10.20.193.12:0/2652704089 conn(0x7f63cc0e6b40 msgr2=0x7f63cc10de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:34.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 shutdown_connections 2026-02-13T21:17:34.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:34.597+0000 7f63d0abf640 1 -- 10.20.193.12:0/2652704089 wait complete. 2026-02-13T21:17:34.641 DEBUG:teuthology.orchestra.run.trial012:osd.1> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.1.service 2026-02-13T21:17:34.643 INFO:tasks.cephadm:Deploying osd.2 on trial012 with /dev/vg_nvme/lv_2... 2026-02-13T21:17:34.644 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T21:17:34.804 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:34.827 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:34 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:34.828 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:34 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:34.828 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:34 trial012 ceph-mon[37926]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T21:17:34.828 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:34 trial012 ceph-mon[37926]: from='osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T21:17:35.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:34 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:34 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:34 trial090 ceph-mon[42877]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T21:17:35.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:34 trial090 ceph-mon[42877]: from='osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T21:17:35.729 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:17:35.746 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch daemon add osd trial012:vg_nvme/lv_2 --skip-validation 2026-02-13T21:17:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: from='osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T21:17:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T21:17:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: from='osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial012", "root=default"]} : dispatch 2026-02-13T21:17:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:35 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:35.811 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: from='osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T21:17:35.811 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T21:17:35.811 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:35.811 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: from='osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial012", "root=default"]} : dispatch 2026-02-13T21:17:35.811 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.812 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.812 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.812 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:35.812 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:35 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:35.812 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:35 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1[65255]: 2026-02-13T21:17:35.561+0000 7fb1b8761640 -1 osd.1 0 waiting for initial osdmap 2026-02-13T21:17:35.812 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:35 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1[65255]: 2026-02-13T21:17:35.563+0000 7fb1afd41640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T21:17:35.871 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:36.006 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.000+0000 7fac2cff8640 1 -- 10.20.193.12:0/720525029 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810c880 msgr2=0x7fac2810ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:36.006 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.000+0000 7fac2cff8640 1 --2- 10.20.193.12:0/720525029 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810c880 0x7fac2810ccf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fac1c005fd0 tx=0x7fac1c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.000+0000 7fac2cff8640 1 -- 10.20.193.12:0/720525029 shutdown_connections 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.000+0000 7fac2cff8640 1 --2- 10.20.193.12:0/720525029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac2810d9b0 0x7fac2810ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.000+0000 7fac2cff8640 1 --2- 10.20.193.12:0/720525029 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810c880 0x7fac2810ccf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.000+0000 7fac2cff8640 1 -- 10.20.193.12:0/720525029 >> 10.20.193.12:0/720525029 conn(0x7fac280e9f40 msgr2=0x7fac2810a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.000+0000 7fac2cff8640 1 -- 10.20.193.12:0/720525029 shutdown_connections 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.000+0000 7fac2cff8640 1 -- 10.20.193.12:0/720525029 wait complete. 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac2cff8640 1 Processor -- start 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac2cff8640 1 -- start start 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac2cff8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac2810c880 0x7fac280f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:36.007 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac2cff8640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810d9b0 0x7fac280f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac2cff8640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fac28151690 con 0x7fac2810d9b0 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac2cff8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac28151510 con 0x7fac2810c880 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac25d74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810d9b0 0x7fac280f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac25d74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810d9b0 0x7fac280f6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:44622/0 (socket says 10.20.193.12:44622) 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac25d74640 1 -- 10.20.193.12:0/377785363 learned_addr learned my addr 10.20.193.12:0/377785363 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac26575640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac2810c880 0x7fac280f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac25d74640 1 -- 10.20.193.12:0/377785363 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac2810c880 msgr2=0x7fac280f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac25d74640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac2810c880 0x7fac280f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac25d74640 1 -- 10.20.193.12:0/377785363 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac280f7420 con 0x7fac2810d9b0 2026-02-13T21:17:36.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.001+0000 7fac25d74640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810d9b0 0x7fac280f6830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac100094b0 tx=0x7fac1000ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:36.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.002+0000 7fac0f7fe640 1 -- 10.20.193.12:0/377785363 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fac1000cac0 con 0x7fac2810d9b0 2026-02-13T21:17:36.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.002+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac280f7710 con 0x7fac2810d9b0 2026-02-13T21:17:36.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.002+0000 7fac0f7fe640 1 -- 10.20.193.12:0/377785363 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fac10004d10 con 0x7fac2810d9b0 2026-02-13T21:17:36.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.002+0000 7fac0f7fe640 1 -- 10.20.193.12:0/377785363 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fac10005720 con 0x7fac2810d9b0 2026-02-13T21:17:36.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.002+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac280f7d20 con 0x7fac2810d9b0 2026-02-13T21:17:36.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.002+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2810ddc0 con 0x7fac2810d9b0 2026-02-13T21:17:36.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.003+0000 7fac0f7fe640 1 -- 10.20.193.12:0/377785363 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7fac100047a0 con 0x7fac2810d9b0 2026-02-13T21:17:36.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.003+0000 7fac0f7fe640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fac000794e0 0x7fac000999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:36.010 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.004+0000 7fac0f7fe640 1 -- 10.20.193.12:0/377785363 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2127+0+0 (secure 0 0 0) 0x7fac1009bc80 con 0x7fac2810d9b0 2026-02-13T21:17:36.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.004+0000 7fac26575640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fac000794e0 0x7fac000999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:36.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.004+0000 7fac26575640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fac000794e0 0x7fac000999f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac1c002400 tx=0x7fac1c031040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:36.011 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.006+0000 7fac0f7fe640 1 -- 10.20.193.12:0/377785363 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fac10069bb0 con 0x7fac2810d9b0 2026-02-13T21:17:36.129 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:36.126+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fac280ef290 con 0x7fac000794e0 2026-02-13T21:17:36.657 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial012", "root=default"]}]': finished 2026-02-13T21:17:36.657 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: osdmap e12: 2 total, 1 up, 2 in 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:36.658 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial012", "root=default"]}]': finished 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: osdmap e12: 2 total, 1 up, 2 in 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:37.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:37.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:37.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:37.822 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: purged_snaps scrub starts 2026-02-13T21:17:37.822 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: purged_snaps scrub ok 2026-02-13T21:17:37.822 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: from='client.14378 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:37.822 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: osd.default does not exist. Creating it now. 2026-02-13T21:17:37.822 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: Creating OSDs with service ID: default on trial012:['vg_nvme/lv_2'] 2026-02-13T21:17:37.822 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: Marking host: trial012 for OSDSpec preview refresh. 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: Saving service osd.default spec with placement trial012 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] boot 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: osdmap e13: 2 total, 2 up, 2 in 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/659326625' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "752d80ce-ee90-4e8a-9ccb-626e1ff2ce72"} : dispatch 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/659326625' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "752d80ce-ee90-4e8a-9ccb-626e1ff2ce72"}]': finished 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:37.823 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:37 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3536767982' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:38.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: purged_snaps scrub starts 2026-02-13T21:17:38.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: purged_snaps scrub ok 2026-02-13T21:17:38.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: from='client.14378 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:38.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: osd.default does not exist. Creating it now. 2026-02-13T21:17:38.022 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: Creating OSDs with service ID: default on trial012:['vg_nvme/lv_2'] 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: Marking host: trial012 for OSDSpec preview refresh. 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: Saving service osd.default spec with placement trial012 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: osd.1 [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] boot 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: osdmap e13: 2 total, 2 up, 2 in 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/659326625' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "752d80ce-ee90-4e8a-9ccb-626e1ff2ce72"} : dispatch 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/659326625' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "752d80ce-ee90-4e8a-9ccb-626e1ff2ce72"}]': finished 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:38.023 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:37 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3536767982' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:38.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T21:17:38.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: osdmap e15: 3 total, 2 up, 3 in 2026-02-13T21:17:38.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:38.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:38.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:38.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:38.877 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T21:17:38.878 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: osdmap e15: 3 total, 2 up, 3 in 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T21:17:39.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:40.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:39 trial012 ceph-mon[37926]: Detected new or changed devices on trial012 2026-02-13T21:17:40.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:39 trial012 ceph-mon[37926]: Adjusting osd_memory_target on trial012 to 39399M 2026-02-13T21:17:40.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:39 trial012 ceph-mon[37926]: Deploying daemon osd.2 on trial012 2026-02-13T21:17:40.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:39 trial090 ceph-mon[42877]: Detected new or changed devices on trial012 2026-02-13T21:17:40.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:39 trial090 ceph-mon[42877]: Adjusting osd_memory_target on trial012 to 39399M 2026-02-13T21:17:40.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:39 trial090 ceph-mon[42877]: Deploying daemon osd.2 on trial012 2026-02-13T21:17:41.090 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:40 trial012 ceph-mon[37926]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T21:17:41.090 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:40 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:41.090 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:40 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:41.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:40 trial090 ceph-mon[42877]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T21:17:41.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:40 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:41.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:40 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:41.603 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.599+0000 7fac0f7fe640 1 -- 10.20.193.12:0/377785363 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fac280ef290 con 0x7fac000794e0 2026-02-13T21:17:41.603 INFO:teuthology.orchestra.run.trial012.stdout:Created osd(s) 2 on host 'trial012' 2026-02-13T21:17:41.606 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fac000794e0 msgr2=0x7fac000999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:41.606 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fac000794e0 0x7fac000999f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac1c002400 tx=0x7fac1c031040 comp rx=0 tx=0).stop 2026-02-13T21:17:41.606 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810d9b0 msgr2=0x7fac280f6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:41.606 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810d9b0 0x7fac280f6830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac100094b0 tx=0x7fac1000ede0 comp rx=0 tx=0).stop 2026-02-13T21:17:41.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 shutdown_connections 2026-02-13T21:17:41.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fac000794e0 0x7fac000999f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:41.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fac2810d9b0 0x7fac280f6830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:41.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 --2- 10.20.193.12:0/377785363 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac2810c880 0x7fac280f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:41.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 >> 10.20.193.12:0/377785363 conn(0x7fac280e9f40 msgr2=0x7fac280ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:41.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 shutdown_connections 2026-02-13T21:17:41.608 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:41.602+0000 7fac2cff8640 1 -- 10.20.193.12:0/377785363 wait complete. 2026-02-13T21:17:41.644 DEBUG:teuthology.orchestra.run.trial012:osd.2> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.2.service 2026-02-13T21:17:41.647 INFO:tasks.cephadm:Deploying osd.3 on trial012 with /dev/vg_nvme/lv_1... 2026-02-13T21:17:41.647 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T21:17:41.806 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:41.874 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:41 trial012 ceph-mon[37926]: from='osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T21:17:41.875 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:41.875 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:42.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:41 trial090 ceph-mon[42877]: from='osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T21:17:42.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:42.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:42.726 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:17:42.746 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch daemon add osd trial012:vg_nvme/lv_1 --skip-validation 2026-02-13T21:17:42.869 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.994+0000 7fde79a11640 1 -- 10.20.193.12:0/4034356887 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 msgr2=0x7fde7410bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.994+0000 7fde79a11640 1 --2- 10.20.193.12:0/4034356887 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 0x7fde7410bb30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde5c005fd0 tx=0x7fde5c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.994+0000 7fde79a11640 1 -- 10.20.193.12:0/4034356887 shutdown_connections 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.994+0000 7fde79a11640 1 --2- 10.20.193.12:0/4034356887 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 0x7fde7410bb30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.994+0000 7fde79a11640 1 --2- 10.20.193.12:0/4034356887 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde7410a5f0 0x7fde7410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.994+0000 7fde79a11640 1 -- 10.20.193.12:0/4034356887 >> 10.20.193.12:0/4034356887 conn(0x7fde740e7cb0 msgr2=0x7fde74108140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.994+0000 7fde79a11640 1 -- 10.20.193.12:0/4034356887 shutdown_connections 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.994+0000 7fde79a11640 1 -- 10.20.193.12:0/4034356887 wait complete. 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde79a11640 1 Processor -- start 2026-02-13T21:17:42.997 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde79a11640 1 -- start start 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde79a11640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde7410a5f0 0x7fde740f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde79a11640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 0x7fde740f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde79a11640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde7414f410 con 0x7fde7410b720 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde79a11640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde7414f290 con 0x7fde7410a5f0 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde727fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 0x7fde740f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde727fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 0x7fde740f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:47570/0 (socket says 10.20.193.12:47570) 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde727fc640 1 -- 10.20.193.12:0/2399397281 learned_addr learned my addr 10.20.193.12:0/2399397281 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde72ffd640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde7410a5f0 0x7fde740f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde727fc640 1 -- 10.20.193.12:0/2399397281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde7410a5f0 msgr2=0x7fde740f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde727fc640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde7410a5f0 0x7fde740f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde727fc640 1 -- 10.20.193.12:0/2399397281 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde740f7440 con 0x7fde7410b720 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde727fc640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 0x7fde740f6850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde5c005b60 tx=0x7fde5c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde78a0f640 1 -- 10.20.193.12:0/2399397281 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fde5c046070 con 0x7fde7410b720 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde740f76d0 con 0x7fde7410b720 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde78a0f640 1 -- 10.20.193.12:0/2399397281 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fde5c038900 con 0x7fde7410b720 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde78a0f640 1 -- 10.20.193.12:0/2399397281 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fde5c041830 con 0x7fde7410b720 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.995+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde740f7c50 con 0x7fde7410b720 2026-02-13T21:17:42.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.996+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7410aa60 con 0x7fde7410b720 2026-02-13T21:17:42.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.997+0000 7fde78a0f640 1 -- 10.20.193.12:0/2399397281 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7fde5c038470 con 0x7fde7410b720 2026-02-13T21:17:42.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.997+0000 7fde78a0f640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fde48079360 0x7fde48099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:42.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.997+0000 7fde78a0f640 1 -- 10.20.193.12:0/2399397281 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2559+0+0 (secure 0 0 0) 0x7fde5c03e070 con 0x7fde7410b720 2026-02-13T21:17:42.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.997+0000 7fde72ffd640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fde48079360 0x7fde48099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:43.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:42.998+0000 7fde72ffd640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fde48079360 0x7fde48099870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde68004770 tx=0x7fde68005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:43.002 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:43.000+0000 7fde78a0f640 1 -- 10.20.193.12:0/2399397281 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fde5c050080 con 0x7fde7410b720 2026-02-13T21:17:43.067 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: from='osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: osdmap e16: 3 total, 2 up, 3 in 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: from='osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial012", "root=default"]} : dispatch 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:43.068 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:43.068 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:42 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2[71274]: 2026-02-13T21:17:42.873+0000 7f23d3465640 -1 osd.2 0 waiting for initial osdmap 2026-02-13T21:17:43.068 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:42 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2[71274]: 2026-02-13T21:17:42.875+0000 7f23caa45640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T21:17:43.115 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:43.112+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fde7405fe40 con 0x7fde48079360 2026-02-13T21:17:43.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T21:17:43.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: from='osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T21:17:43.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: osdmap e16: 3 total, 2 up, 3 in 2026-02-13T21:17:43.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: from='osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial012", "root=default"]} : dispatch 2026-02-13T21:17:43.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:43.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:43.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:43.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:43.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:43.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial012", "root=default"]}]': finished 2026-02-13T21:17:44.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: osdmap e17: 3 total, 2 up, 3 in 2026-02-13T21:17:44.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:44.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:44.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1786153230' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e4c26bc-c190-453c-bd22-452337fb54fe"} : dispatch 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1786153230' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e4c26bc-c190-453c-bd22-452337fb54fe"}]': finished 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] boot 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:44.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:44.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial012", "root=default"]}]': finished 2026-02-13T21:17:44.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: osdmap e17: 3 total, 2 up, 3 in 2026-02-13T21:17:44.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:44.272 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1786153230' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e4c26bc-c190-453c-bd22-452337fb54fe"} : dispatch 2026-02-13T21:17:44.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1786153230' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e4c26bc-c190-453c-bd22-452337fb54fe"}]': finished 2026-02-13T21:17:44.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: osd.2 [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] boot 2026-02-13T21:17:44.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T21:17:44.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T21:17:44.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:45.029 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: purged_snaps scrub starts 2026-02-13T21:17:45.030 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: purged_snaps scrub ok 2026-02-13T21:17:45.030 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: from='client.14396 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:45.030 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: osd.default does not exist. Creating it now. 2026-02-13T21:17:45.030 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: Creating OSDs with service ID: default on trial012:['vg_nvme/lv_1'] 2026-02-13T21:17:45.030 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: Marking host: trial012 for OSDSpec preview refresh. 2026-02-13T21:17:45.030 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: Saving service osd.default spec with placement trial012 2026-02-13T21:17:45.030 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T21:17:45.030 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:44 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/263529144' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:45.173 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: purged_snaps scrub starts 2026-02-13T21:17:45.173 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: purged_snaps scrub ok 2026-02-13T21:17:45.173 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: from='client.14396 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial012:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:45.173 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: osd.default does not exist. Creating it now. 2026-02-13T21:17:45.173 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: Creating OSDs with service ID: default on trial012:['vg_nvme/lv_1'] 2026-02-13T21:17:45.173 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: Marking host: trial012 for OSDSpec preview refresh. 2026-02-13T21:17:45.173 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: Saving service osd.default spec with placement trial012 2026-02-13T21:17:45.173 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T21:17:45.174 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:44 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/263529144' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:46.457 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T21:17:46.457 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:46.457 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: Detected new or changed devices on trial012 2026-02-13T21:17:46.457 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.457 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.458 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.458 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.458 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:46.458 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:46.458 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:46.459 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: Adjusting osd_memory_target on trial012 to 26266M 2026-02-13T21:17:46.459 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.459 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:46.459 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:46.459 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.459 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:46.459 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:46.459 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:46.460 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: pgmap v29: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T21:17:46.460 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T21:17:46.460 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:46.460 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: Deploying daemon osd.3 on trial012 2026-02-13T21:17:46.460 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T21:17:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T21:17:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: Detected new or changed devices on trial012 2026-02-13T21:17:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: Adjusting osd_memory_target on trial012 to 26266M 2026-02-13T21:17:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:46.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:46.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:46.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:46.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:46.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:46.775 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: pgmap v29: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T21:17:46.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T21:17:46.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:46.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: Deploying daemon osd.3 on trial012 2026-02-13T21:17:46.776 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T21:17:47.630 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T21:17:47.630 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:47 trial012 ceph-mon[37926]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T21:17:47.630 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:47.630 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T21:17:47.630 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:17:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T21:17:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:47 trial090 ceph-mon[42877]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T21:17:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T21:17:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:17:48.481 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77768]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T21:17:48.481 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77768]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.482 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.482 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77768]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.482 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77787]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T21:17:48.482 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.482 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.482 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77787]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.482 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77900]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T21:17:48.483 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77900]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.483 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.483 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77900]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.483 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 sudo[78027]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T21:17:48.483 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 sudo[78027]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.483 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 sudo[78027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.483 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 sudo[78027]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.483 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T21:17:48.483 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77719]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77719]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77719]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77735]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77735]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77735]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77793]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T21:17:48.484 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77793]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.485 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.485 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77793]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.485 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77808]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T21:17:48.485 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77808]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.485 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.485 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:17:48 trial012 sudo[77808]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.602 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.599+0000 7fde78a0f640 1 -- 10.20.193.12:0/2399397281 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fde7405fe40 con 0x7fde48079360 2026-02-13T21:17:48.602 INFO:teuthology.orchestra.run.trial012.stdout:Created osd(s) 3 on host 'trial012' 2026-02-13T21:17:48.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fde48079360 msgr2=0x7fde48099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:48.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fde48079360 0x7fde48099870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde68004770 tx=0x7fde68005f30 comp rx=0 tx=0).stop 2026-02-13T21:17:48.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 msgr2=0x7fde740f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:48.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 0x7fde740f6850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde5c005b60 tx=0x7fde5c004290 comp rx=0 tx=0).stop 2026-02-13T21:17:48.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 shutdown_connections 2026-02-13T21:17:48.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fde48079360 0x7fde48099870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:48.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fde7410b720 0x7fde740f6850 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:48.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 --2- 10.20.193.12:0/2399397281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde7410a5f0 0x7fde740f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:48.606 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 >> 10.20.193.12:0/2399397281 conn(0x7fde740e7cb0 msgr2=0x7fde7405e720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:48.606 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 shutdown_connections 2026-02-13T21:17:48.606 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:17:48.602+0000 7fde79a11640 1 -- 10.20.193.12:0/2399397281 wait complete. 2026-02-13T21:17:48.644 DEBUG:teuthology.orchestra.run.trial012:osd.3> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.3.service 2026-02-13T21:17:48.645 INFO:tasks.cephadm:Deploying osd.4 on trial090 with /dev/vg_nvme/lv_4... 2026-02-13T21:17:48.645 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T21:17:48.669 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 sudo[46076]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 sudo[46076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 sudo[46076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 sudo[46076]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 sudo[46080]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 sudo[46080]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 sudo[46080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 sudo[46080]: pam_unix(sudo:session): session closed for user root 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T21:17:48.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: pgmap v32: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:48.671 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:48.672 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T21:17:48.672 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T21:17:48.672 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T21:17:48.672 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.766 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:17:48.770 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T21:17:48.770 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: pgmap v32: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial012"} : dispatch 2026-02-13T21:17:48.771 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mon metadata", "id": "trial090"} : dispatch 2026-02-13T21:17:48.772 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T21:17:48.772 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T21:17:48.772 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T21:17:48.772 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.242 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:49.259 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_4 --skip-validation 2026-02-13T21:17:49.415 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:17:49.536 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.531+0000 7f4a54a83640 1 -- 10.20.193.90:0/2435704521 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 msgr2=0x7f4a5010ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:49.536 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.531+0000 7f4a54a83640 1 --2- 10.20.193.90:0/2435704521 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 0x7f4a5010ccf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005fd0 tx=0x7f4a4402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:49.536 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.531+0000 7f4a54a83640 1 -- 10.20.193.90:0/2435704521 shutdown_connections 2026-02-13T21:17:49.536 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.531+0000 7f4a54a83640 1 --2- 10.20.193.90:0/2435704521 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4a5010d9b0 0x7f4a5010ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.531+0000 7f4a54a83640 1 --2- 10.20.193.90:0/2435704521 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 0x7f4a5010ccf0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.531+0000 7f4a54a83640 1 -- 10.20.193.90:0/2435704521 >> 10.20.193.90:0/2435704521 conn(0x7f4a500e9f40 msgr2=0x7f4a5010a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.531+0000 7f4a54a83640 1 -- 10.20.193.90:0/2435704521 shutdown_connections 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.531+0000 7f4a54a83640 1 -- 10.20.193.90:0/2435704521 wait complete. 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a54a83640 1 Processor -- start 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a54a83640 1 -- start start 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a54a83640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 0x7f4a500f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a54a83640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4a5010d9b0 0x7f4a500f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:49.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a54a83640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a50151690 con 0x7f4a5010d9b0 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a54a83640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a50151510 con 0x7f4a5010c880 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 0x7f4a500f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 0x7f4a500f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:42436/0 (socket says 10.20.193.90:42436) 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4e575640 1 -- 10.20.193.90:0/108330959 learned_addr learned my addr 10.20.193.90:0/108330959 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4dd74640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4a5010d9b0 0x7f4a500f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4e575640 1 -- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4a5010d9b0 msgr2=0x7f4a500f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4e575640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4a5010d9b0 0x7f4a500f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4e575640 1 -- 10.20.193.90:0/108330959 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a500f7420 con 0x7f4a5010c880 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4dd74640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4a5010d9b0 0x7f4a500f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:17:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a4e575640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 0x7f4a500f61c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005b60 tx=0x7f4a44004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a377fe640 1 -- 10.20.193.90:0/108330959 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4a44046070 con 0x7f4a5010c880 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a500f76b0 con 0x7f4a5010c880 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a377fe640 1 -- 10.20.193.90:0/108330959 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f4a44038900 con 0x7f4a5010c880 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a377fe640 1 -- 10.20.193.90:0/108330959 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4a44041830 con 0x7f4a5010c880 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.532+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a500f7c30 con 0x7f4a5010c880 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.533+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a5010ddc0 con 0x7f4a5010c880 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.534+0000 7f4a377fe640 1 -- 10.20.193.90:0/108330959 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 18) ==== 103419+0+0 (secure 0 0 0) 0x7f4a44038470 con 0x7f4a5010c880 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.534+0000 7f4a377fe640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4a28079360 0x7f4a28099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.534+0000 7f4a377fe640 1 -- 10.20.193.90:0/108330959 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3364+0+0 (secure 0 0 0) 0x7f4a4403e070 con 0x7f4a5010c880 2026-02-13T21:17:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.534+0000 7f4a4dd74640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4a28079360 0x7f4a28099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.535+0000 7f4a4dd74640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4a28079360 0x7f4a28099870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004770 tx=0x7f4a38005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.537+0000 7f4a377fe640 1 -- 10.20.193.90:0/108330959 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f4a44050080 con 0x7f4a5010c880 2026-02-13T21:17:49.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:49.650+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f4a500ef000 con 0x7f4a28079360 2026-02-13T21:17:49.722 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.723 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.723 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: from='osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T21:17:49.723 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: osdmap e22: 4 total, 3 up, 4 in 2026-02-13T21:17:49.723 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: from='osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial012", "root=default"]} : dispatch 2026-02-13T21:17:49.723 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:49.723 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.723 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.723 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:49 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: from='osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T21:17:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: osdmap e22: 4 total, 3 up, 4 in 2026-02-13T21:17:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: from='osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial012", "root=default"]} : dispatch 2026-02-13T21:17:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:49.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:49 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:50.031 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:17:49 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3[77345]: 2026-02-13T21:17:49.719+0000 7fb493f0e640 -1 osd.3 0 waiting for initial osdmap 2026-02-13T21:17:50.032 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:17:49 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3[77345]: 2026-02-13T21:17:49.721+0000 7fb48f4f6640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T21:17:50.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:50.599+0000 7f4a377fe640 1 -- 10.20.193.90:0/108330959 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f4a44084f80 con 0x7f4a5010c880 2026-02-13T21:17:50.681 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: pgmap v34: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T21:17:50.681 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: osd.default does not exist. Creating it now. 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_4'] 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: Saving service osd.default spec with placement trial090 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:50.682 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial012", "root=default"]}]': finished 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: osdmap e23: 4 total, 3 up, 4 in 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a92779e-4460-41dc-b18a-4c646ac46091"} : dispatch 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/2010238155' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a92779e-4460-41dc-b18a-4c646ac46091"} : dispatch 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a92779e-4460-41dc-b18a-4c646ac46091"}]': finished 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] boot 2026-02-13T21:17:50.683 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T21:17:50.684 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:50.684 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:50.684 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: mgrmap e19: trial012.zqhrrq(active, since 48s), standbys: trial090.qsdrej 2026-02-13T21:17:50.684 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:50 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/445727092' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:51.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: pgmap v34: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T21:17:51.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:51.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: osd.default does not exist. Creating it now. 2026-02-13T21:17:51.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_4'] 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: Saving service osd.default spec with placement trial090 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial012", "root=default"]}]': finished 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: osdmap e23: 4 total, 3 up, 4 in 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:51.127 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a92779e-4460-41dc-b18a-4c646ac46091"} : dispatch 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/2010238155' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a92779e-4460-41dc-b18a-4c646ac46091"} : dispatch 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a92779e-4460-41dc-b18a-4c646ac46091"}]': finished 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: osd.3 [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] boot 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: mgrmap e19: trial012.zqhrrq(active, since 48s), standbys: trial090.qsdrej 2026-02-13T21:17:51.128 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:50 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/445727092' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: purged_snaps scrub starts 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: purged_snaps scrub ok 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: Adjusting osd_memory_target on trial012 to 19699M 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T21:17:52.144 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:52.145 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:51 trial090 ceph-mon[42877]: pgmap v38: 1 pgs: 1 creating+activating; 0 B data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T21:17:52.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: purged_snaps scrub starts 2026-02-13T21:17:52.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: purged_snaps scrub ok 2026-02-13T21:17:52.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:52.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:52.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:52.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:52.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: Adjusting osd_memory_target on trial012 to 19699M 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:52.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:51 trial012 ceph-mon[37926]: pgmap v38: 1 pgs: 1 creating+activating; 0 B data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T21:17:52.944 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:52 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T21:17:52.944 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:52 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:52.944 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:52 trial090 ceph-mon[42877]: Deploying daemon osd.4 on trial090 2026-02-13T21:17:52.944 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:52 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T21:17:52.944 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:52 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:52.944 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:52 trial090 ceph-mon[42877]: Deploying daemon osd.4 on trial090 2026-02-13T21:17:53.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:52 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T21:17:53.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:52 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:53.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:52 trial012 ceph-mon[37926]: Deploying daemon osd.4 on trial090 2026-02-13T21:17:53.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:52 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T21:17:53.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:52 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:53.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:52 trial012 ceph-mon[37926]: Deploying daemon osd.4 on trial090 2026-02-13T21:17:54.180 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:53 trial090 ceph-mon[42877]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T21:17:54.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:53 trial012 ceph-mon[37926]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T21:17:55.064 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:54 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:55.064 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:54 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:55.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:54 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:55.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:54 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:56.096 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:55 trial090 ceph-mon[42877]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T21:17:56.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:55 trial012 ceph-mon[37926]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T21:17:56.933 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.932+0000 7f4a377fe640 1 -- 10.20.193.90:0/108330959 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f4a500ef000 con 0x7f4a28079360 2026-02-13T21:17:56.933 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 4 on host 'trial090' 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4a28079360 msgr2=0x7f4a28099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4a28079360 0x7f4a28099870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004770 tx=0x7f4a38005f30 comp rx=0 tx=0).stop 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 msgr2=0x7f4a500f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 0x7f4a500f61c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005b60 tx=0x7f4a44004290 comp rx=0 tx=0).stop 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 shutdown_connections 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4a28079360 0x7f4a28099870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4a5010d9b0 0x7f4a500f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 --2- 10.20.193.90:0/108330959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4a5010c880 0x7f4a500f61c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 >> 10.20.193.90:0/108330959 conn(0x7f4a500e9f40 msgr2=0x7f4a500ec560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 shutdown_connections 2026-02-13T21:17:56.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:56.934+0000 7f4a54a83640 1 -- 10.20.193.90:0/108330959 wait complete. 2026-02-13T21:17:56.976 DEBUG:teuthology.orchestra.run.trial090:osd.4> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.4.service 2026-02-13T21:17:56.979 INFO:tasks.cephadm:Deploying osd.5 on trial090 with /dev/vg_nvme/lv_3... 2026-02-13T21:17:56.979 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T21:17:57.135 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:17:57.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:57 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:57.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:57 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:57.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:57 trial090 ceph-mon[42877]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T21:17:57.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:57 trial090 ceph-mon[42877]: from='osd.4 [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T21:17:57.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:57 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:57.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:57 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:57.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:57 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:57.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:57 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:57.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:57 trial012 ceph-mon[37926]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T21:17:57.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:57 trial012 ceph-mon[37926]: from='osd.4 [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T21:17:57.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:57 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:57.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:57 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:58.106 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:17:58.122 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_3 --skip-validation 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: from='osd.4 [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:58.211 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:58 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:58.242 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: from='osd.4 [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:58.266 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:58 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:17:58.267 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:17:58 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4[49885]: 2026-02-13T21:17:58.181+0000 7f3dc694c640 -1 osd.4 0 waiting for initial osdmap 2026-02-13T21:17:58.267 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:17:58 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4[49885]: 2026-02-13T21:17:58.184+0000 7f3dbd718640 -1 osd.4 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T21:17:58.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 -- 10.20.193.90:0/3167120538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f318005edc0 msgr2=0x7f318005f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:58.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 --2- 10.20.193.90:0/3167120538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f318005edc0 0x7f318005f1d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3174009930 tx=0x7f317402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:17:58.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 -- 10.20.193.90:0/3167120538 shutdown_connections 2026-02-13T21:17:58.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 --2- 10.20.193.90:0/3167120538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f318005edc0 0x7f318005f1d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:58.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 --2- 10.20.193.90:0/3167120538 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3180060250 0x7f318005e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:58.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 -- 10.20.193.90:0/3167120538 >> 10.20.193.90:0/3167120538 conn(0x7f31800e7cb0 msgr2=0x7f3180108140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:17:58.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 -- 10.20.193.90:0/3167120538 shutdown_connections 2026-02-13T21:17:58.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 -- 10.20.193.90:0/3167120538 wait complete. 2026-02-13T21:17:58.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 Processor -- start 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.366+0000 7f3187858640 1 -- start start 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3187858640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f318005edc0 0x7f31800f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3187858640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3180060250 0x7f31800f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3187858640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3180151690 con 0x7f318005edc0 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3187858640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3180151510 con 0x7f3180060250 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3184dcc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3180060250 0x7f31800f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3184dcc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3180060250 0x7f31800f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:42508/0 (socket says 10.20.193.90:42508) 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3184dcc640 1 -- 10.20.193.90:0/404577903 learned_addr learned my addr 10.20.193.90:0/404577903 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f31855cd640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f318005edc0 0x7f31800f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3184dcc640 1 -- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f318005edc0 msgr2=0x7f31800f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:17:58.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3184dcc640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f318005edc0 0x7f31800f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3184dcc640 1 -- 10.20.193.90:0/404577903 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31800f51f0 con 0x7f3180060250 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3184dcc640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3180060250 0x7f31800f4600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3174005a20 tx=0x7f3174004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f316e7fc640 1 -- 10.20.193.90:0/404577903 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3174046070 con 0x7f3180060250 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31800f5480 con 0x7f3180060250 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f316e7fc640 1 -- 10.20.193.90:0/404577903 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f3174038900 con 0x7f3180060250 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f316e7fc640 1 -- 10.20.193.90:0/404577903 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f31740417c0 con 0x7f3180060250 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.367+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31800f5a30 con 0x7f3180060250 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.368+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318005f1d0 con 0x7f3180060250 2026-02-13T21:17:58.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.369+0000 7f316e7fc640 1 -- 10.20.193.90:0/404577903 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f3174038ab0 con 0x7f3180060250 2026-02-13T21:17:58.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.369+0000 7f316e7fc640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f315c0793f0 0x7f315c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:17:58.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.370+0000 7f316e7fc640 1 -- 10.20.193.90:0/404577903 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3920+0+0 (secure 0 0 0) 0x7f317403e070 con 0x7f3180060250 2026-02-13T21:17:58.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.370+0000 7f31855cd640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f315c0793f0 0x7f315c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:17:58.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.370+0000 7f31855cd640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f315c0793f0 0x7f315c099900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3170005fd0 tx=0x7f31700073d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:17:58.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.372+0000 7f316e7fc640 1 -- 10.20.193.90:0/404577903 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f3174050080 con 0x7f3180060250 2026-02-13T21:17:58.488 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:17:58.487+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f31800ea920 con 0x7f315c0793f0 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: osd.default does not exist. Creating it now. 2026-02-13T21:17:59.269 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_3'] 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: Saving service osd.default spec with placement trial090 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.270 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.271 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.271 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.271 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:59.271 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:17:59 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-13T21:17:59.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T21:17:59.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:59.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:17:59.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: osd.default does not exist. Creating it now. 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_3'] 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: Saving service osd.default spec with placement trial090 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:17:59.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T21:17:59.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:17:59 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:00.470 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: purged_snaps scrub starts 2026-02-13T21:18:00.470 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: purged_snaps scrub ok 2026-02-13T21:18:00.470 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: Detected new or changed devices on trial090 2026-02-13T21:18:00.470 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: Adjusting osd_memory_target on trial090 to 81871M 2026-02-13T21:18:00.470 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: osd.4 [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] boot 2026-02-13T21:18:00.470 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: osdmap e28: 5 total, 5 up, 5 in 2026-02-13T21:18:00.470 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:18:00.470 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40f7e047-3d3d-4bd2-9964-d29a3ff11482"} : dispatch 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/3869410846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40f7e047-3d3d-4bd2-9964-d29a3ff11482"} : dispatch 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40f7e047-3d3d-4bd2-9964-d29a3ff11482"}]': finished 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T21:18:00.471 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:00 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/3607374541' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:18:00.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: purged_snaps scrub starts 2026-02-13T21:18:00.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: purged_snaps scrub ok 2026-02-13T21:18:00.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: Detected new or changed devices on trial090 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: Adjusting osd_memory_target on trial090 to 81871M 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: osd.4 [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] boot 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: osdmap e28: 5 total, 5 up, 5 in 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40f7e047-3d3d-4bd2-9964-d29a3ff11482"} : dispatch 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/3869410846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40f7e047-3d3d-4bd2-9964-d29a3ff11482"} : dispatch 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40f7e047-3d3d-4bd2-9964-d29a3ff11482"}]': finished 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T21:18:00.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:00.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T21:18:00.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:00 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/3607374541' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:18:01.578 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:01 trial090 ceph-mon[42877]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T21:18:01.578 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:01 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:01.578 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:01 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T21:18:01.578 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:01 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:01.578 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:01 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T21:18:01.578 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:01 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:01.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:01 trial012 ceph-mon[37926]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T21:18:01.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:01.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T21:18:01.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:01.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T21:18:01.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:01 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:02.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:02 trial090 ceph-mon[42877]: Deploying daemon osd.5 on trial090 2026-02-13T21:18:02.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:02 trial090 ceph-mon[42877]: Deploying daemon osd.5 on trial090 2026-02-13T21:18:02.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:02 trial090 ceph-mon[42877]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T21:18:02.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:02 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:18:02.875 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:02 trial012 ceph-mon[37926]: Deploying daemon osd.5 on trial090 2026-02-13T21:18:02.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:02 trial012 ceph-mon[37926]: Deploying daemon osd.5 on trial090 2026-02-13T21:18:02.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:02 trial012 ceph-mon[37926]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T21:18:02.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:02 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:18:04.236 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:04 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:04.237 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:04 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:04.237 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:04 trial090 ceph-mon[42877]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 106 KiB/s, 0 objects/s recovering 2026-02-13T21:18:04.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:04.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:04 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:04.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:04 trial012 ceph-mon[37926]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 106 KiB/s, 0 objects/s recovering 2026-02-13T21:18:06.032 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 5 on host 'trial090' 2026-02-13T21:18:06.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.030+0000 7f316e7fc640 1 -- 10.20.193.90:0/404577903 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f31800ea920 con 0x7f315c0793f0 2026-02-13T21:18:06.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f315c0793f0 msgr2=0x7f315c099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f315c0793f0 0x7f315c099900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3170005fd0 tx=0x7f31700073d0 comp rx=0 tx=0).stop 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3180060250 msgr2=0x7f31800f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3180060250 0x7f31800f4600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3174005a20 tx=0x7f3174004290 comp rx=0 tx=0).stop 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 shutdown_connections 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f315c0793f0 0x7f315c099900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3180060250 0x7f31800f4600 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 --2- 10.20.193.90:0/404577903 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f318005edc0 0x7f31800f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 >> 10.20.193.90:0/404577903 conn(0x7f31800e7cb0 msgr2=0x7f31800ea210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:06.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 shutdown_connections 2026-02-13T21:18:06.036 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:06.032+0000 7f3187858640 1 -- 10.20.193.90:0/404577903 wait complete. 2026-02-13T21:18:06.074 DEBUG:teuthology.orchestra.run.trial090:osd.5> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.5.service 2026-02-13T21:18:06.077 INFO:tasks.cephadm:Deploying osd.6 on trial090 with /dev/vg_nvme/lv_2... 2026-02-13T21:18:06.077 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T21:18:06.231 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:18:06.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:06 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:06.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:06 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:06.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:06 trial090 ceph-mon[42877]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 89 KiB/s, 0 objects/s recovering 2026-02-13T21:18:06.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:06 trial090 ceph-mon[42877]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T21:18:06.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:06 trial090 ceph-mon[42877]: from='osd.5 [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T21:18:06.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:06 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:06.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:06 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:06.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:06.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:06.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:06 trial012 ceph-mon[37926]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 89 KiB/s, 0 objects/s recovering 2026-02-13T21:18:06.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:06 trial012 ceph-mon[37926]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T21:18:06.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:06 trial012 ceph-mon[37926]: from='osd.5 [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T21:18:06.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:06.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:06 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:07.167 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:07.185 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_2 --skip-validation 2026-02-13T21:18:07.309 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:18:07.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.433+0000 7f0fff51b640 1 -- 10.20.193.90:0/760934461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 msgr2=0x7f0ff810ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:07.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.433+0000 7f0fff51b640 1 --2- 10.20.193.90:0/760934461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 0x7f0ff810ccf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005fd0 tx=0x7f0fe802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:07.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.433+0000 7f0fff51b640 1 -- 10.20.193.90:0/760934461 shutdown_connections 2026-02-13T21:18:07.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.433+0000 7f0fff51b640 1 --2- 10.20.193.90:0/760934461 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ff810d9b0 0x7f0ff810ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:07.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.433+0000 7f0fff51b640 1 --2- 10.20.193.90:0/760934461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 0x7f0ff810ccf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:07.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.433+0000 7f0fff51b640 1 -- 10.20.193.90:0/760934461 >> 10.20.193.90:0/760934461 conn(0x7f0ff80e9f40 msgr2=0x7f0ff810a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:07.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.433+0000 7f0fff51b640 1 -- 10.20.193.90:0/760934461 shutdown_connections 2026-02-13T21:18:07.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.433+0000 7f0fff51b640 1 -- 10.20.193.90:0/760934461 wait complete. 2026-02-13T21:18:07.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fff51b640 1 Processor -- start 2026-02-13T21:18:07.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fff51b640 1 -- start start 2026-02-13T21:18:07.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fff51b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 0x7f0ff80f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:07.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fff51b640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ff810d9b0 0x7f0ff80f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:07.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fff51b640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8151690 con 0x7f0ff810d9b0 2026-02-13T21:18:07.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fff51b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8151510 con 0x7f0ff810c880 2026-02-13T21:18:07.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0ffd290640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 0x7f0ff80f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:07.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0ffd290640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 0x7f0ff80f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43290/0 (socket says 10.20.193.90:43290) 2026-02-13T21:18:07.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0ffd290640 1 -- 10.20.193.90:0/858680284 learned_addr learned my addr 10.20.193.90:0/858680284 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-13T21:18:07.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0ffd290640 1 -- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ff810d9b0 msgr2=0x7f0ff80f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:07.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0ffd290640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ff810d9b0 0x7f0ff80f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:07.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0ffd290640 1 -- 10.20.193.90:0/858680284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff80f7420 con 0x7f0ff810c880 2026-02-13T21:18:07.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0ffd290640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 0x7f0ff80f61c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005a20 tx=0x7f0fe8004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:07.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fe67fc640 1 -- 10.20.193.90:0/858680284 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0fe8046070 con 0x7f0ff810c880 2026-02-13T21:18:07.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff80f76b0 con 0x7f0ff810c880 2026-02-13T21:18:07.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fe67fc640 1 -- 10.20.193.90:0/858680284 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f0fe8038900 con 0x7f0ff810c880 2026-02-13T21:18:07.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fe67fc640 1 -- 10.20.193.90:0/858680284 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0fe8041750 con 0x7f0ff810c880 2026-02-13T21:18:07.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.434+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff80f7c60 con 0x7f0ff810c880 2026-02-13T21:18:07.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.435+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff810ddc0 con 0x7f0ff810c880 2026-02-13T21:18:07.445 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.436+0000 7f0fe67fc640 1 -- 10.20.193.90:0/858680284 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f0fe8038470 con 0x7f0ff810c880 2026-02-13T21:18:07.445 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.437+0000 7f0fe67fc640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0fd40793f0 0x7f0fd4099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:07.445 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.437+0000 7f0fe67fc640 1 -- 10.20.193.90:0/858680284 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4352+0+0 (secure 0 0 0) 0x7f0fe803e070 con 0x7f0ff810c880 2026-02-13T21:18:07.445 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.437+0000 7f0ffca8f640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0fd40793f0 0x7f0fd4099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:07.445 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.438+0000 7f0ffca8f640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0fd40793f0 0x7f0fd4099900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0fec004770 tx=0x7f0fec0096c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:07.446 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.440+0000 7f0fe67fc640 1 -- 10.20.193.90:0/858680284 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f0fe8050080 con 0x7f0ff810c880 2026-02-13T21:18:07.531 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:07 trial012 ceph-mon[37926]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T21:18:07.532 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:07 trial012 ceph-mon[37926]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T21:18:07.532 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:07.532 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:07 trial012 ceph-mon[37926]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:07.532 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:07 trial012 ceph-mon[37926]: from='osd.5 [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:07.532 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:07.532 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:07.532 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:07 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:07.553 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:07.551+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f0ff80ef0e0 con 0x7f0fd40793f0 2026-02-13T21:18:07.553 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:07 trial090 ceph-mon[42877]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T21:18:07.554 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:07 trial090 ceph-mon[42877]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T21:18:07.554 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:07 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:07.554 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:07 trial090 ceph-mon[42877]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:07.554 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:07 trial090 ceph-mon[42877]: from='osd.5 [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:07.554 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:07 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:07.554 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:07 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:07.554 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:07 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:07.554 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:18:07 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:18:07.277+0000 7f4fb62cc640 -1 osd.5 0 waiting for initial osdmap 2026-02-13T21:18:07.555 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:18:07 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:18:07.280+0000 7f4fb18b4640 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T21:18:08.375 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-13T21:18:08.375 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T21:18:08.375 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:08.375 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: osd.default does not exist. Creating it now. 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_2'] 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: Saving service osd.default spec with placement trial090 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:08.376 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:08.377 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 81 KiB/s, 0 objects/s recovering 2026-02-13T21:18:08.377 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.377 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:08 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-13T21:18:08.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T21:18:08.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:08.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:08.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: osd.default does not exist. Creating it now. 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_2'] 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: Saving service osd.default spec with placement trial090 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:08.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 81 KiB/s, 0 objects/s recovering 2026-02-13T21:18:08.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:08.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:08 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:09.429 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: purged_snaps scrub starts 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: purged_snaps scrub ok 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: osd.5 [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] boot 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5837ab08-fa7e-4cc5-bb99-8c046a23cb8c"} : dispatch 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/2543791999' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5837ab08-fa7e-4cc5-bb99-8c046a23cb8c"} : dispatch 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5837ab08-fa7e-4cc5-bb99-8c046a23cb8c"}]': finished 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:09.430 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:09 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/1070497802' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:18:09.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: purged_snaps scrub starts 2026-02-13T21:18:09.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: purged_snaps scrub ok 2026-02-13T21:18:09.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: osd.5 [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] boot 2026-02-13T21:18:09.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T21:18:09.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T21:18:09.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5837ab08-fa7e-4cc5-bb99-8c046a23cb8c"} : dispatch 2026-02-13T21:18:09.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/2543791999' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5837ab08-fa7e-4cc5-bb99-8c046a23cb8c"} : dispatch 2026-02-13T21:18:09.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5837ab08-fa7e-4cc5-bb99-8c046a23cb8c"}]': finished 2026-02-13T21:18:09.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T21:18:09.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:09.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:09 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/1070497802' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: Detected new or changed devices on trial090 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.343 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: Adjusting osd_memory_target on trial090 to 40935M 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T21:18:10.344 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:10 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:10.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T21:18:10.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:10.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T21:18:10.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: Detected new or changed devices on trial090 2026-02-13T21:18:10.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: Adjusting osd_memory_target on trial090 to 40935M 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:10.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:10.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:10.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T21:18:10.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:10 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:11.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:11 trial090 ceph-mon[42877]: Deploying daemon osd.6 on trial090 2026-02-13T21:18:11.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:11 trial090 ceph-mon[42877]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T21:18:11.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:11 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:11.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:11 trial012 ceph-mon[37926]: Deploying daemon osd.6 on trial090 2026-02-13T21:18:11.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:11 trial012 ceph-mon[37926]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T21:18:11.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:11 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:12.570 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:12 trial090 ceph-mon[42877]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T21:18:12.570 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:12 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:12.570 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:12 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:12.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:12 trial012 ceph-mon[37926]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T21:18:12.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:12 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:12.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:12 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:13.075 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.073+0000 7f0fe67fc640 1 -- 10.20.193.90:0/858680284 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f0ff80ef0e0 con 0x7f0fd40793f0 2026-02-13T21:18:13.076 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 6 on host 'trial090' 2026-02-13T21:18:13.078 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0fd40793f0 msgr2=0x7f0fd4099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0fd40793f0 0x7f0fd4099900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0fec004770 tx=0x7f0fec0096c0 comp rx=0 tx=0).stop 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 msgr2=0x7f0ff80f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 0x7f0ff80f61c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005a20 tx=0x7f0fe8004290 comp rx=0 tx=0).stop 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 shutdown_connections 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f0fd40793f0 0x7f0fd4099900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0ff810d9b0 0x7f0ff80f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 --2- 10.20.193.90:0/858680284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ff810c880 0x7f0ff80f61c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 >> 10.20.193.90:0/858680284 conn(0x7f0ff80e9f40 msgr2=0x7f0ff80ec560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 shutdown_connections 2026-02-13T21:18:13.079 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:13.076+0000 7f0fff51b640 1 -- 10.20.193.90:0/858680284 wait complete. 2026-02-13T21:18:13.118 DEBUG:teuthology.orchestra.run.trial090:osd.6> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.6.service 2026-02-13T21:18:13.120 INFO:tasks.cephadm:Deploying osd.7 on trial090 with /dev/vg_nvme/lv_1... 2026-02-13T21:18:13.120 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T21:18:13.279 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:18:13.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:13 trial012 ceph-mon[37926]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T21:18:13.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:13 trial012 ceph-mon[37926]: from='osd.6 [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T21:18:13.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:13.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:13 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:13.668 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:13 trial090 ceph-mon[42877]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T21:18:13.669 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:13 trial090 ceph-mon[42877]: from='osd.6 [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T21:18:13.669 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:13.669 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:13 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:14.130 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:14.149 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_1 --skip-validation 2026-02-13T21:18:14.276 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:18:14.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.405+0000 7f193b608640 1 -- 10.20.193.90:0/3363932262 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410a5f0 msgr2=0x7f193410aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.405+0000 7f193b608640 1 --2- 10.20.193.90:0/3363932262 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410a5f0 0x7f193410aa60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1924005fd0 tx=0x7f192402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.405+0000 7f193b608640 1 -- 10.20.193.90:0/3363932262 shutdown_connections 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.405+0000 7f193b608640 1 --2- 10.20.193.90:0/3363932262 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f193410b720 0x7f193410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.405+0000 7f193b608640 1 --2- 10.20.193.90:0/3363932262 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410a5f0 0x7f193410aa60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.405+0000 7f193b608640 1 -- 10.20.193.90:0/3363932262 >> 10.20.193.90:0/3363932262 conn(0x7f19340e7c90 msgr2=0x7f1934108140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.405+0000 7f193b608640 1 -- 10.20.193.90:0/3363932262 shutdown_connections 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.405+0000 7f193b608640 1 -- 10.20.193.90:0/3363932262 wait complete. 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f193b608640 1 Processor -- start 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f193b608640 1 -- start start 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f193b608640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f193410a5f0 0x7f19340f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:14.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f193b608640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410b720 0x7f19340f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f193b608640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f193414f400 con 0x7f193410a5f0 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f193b608640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f193414f280 con 0x7f193410b720 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f1938b7c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410b720 0x7f19340f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f1938b7c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410b720 0x7f19340f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:37930/0 (socket says 10.20.193.90:37930) 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f1938b7c640 1 -- 10.20.193.90:0/2918684517 learned_addr learned my addr 10.20.193.90:0/2918684517 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f193937d640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f193410a5f0 0x7f19340f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f1938b7c640 1 -- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f193410a5f0 msgr2=0x7f19340f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f1938b7c640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f193410a5f0 0x7f19340f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f1938b7c640 1 -- 10.20.193.90:0/2918684517 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19340f51a0 con 0x7f193410b720 2026-02-13T21:18:14.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f193937d640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f193410a5f0 0x7f19340f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:14.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f1938b7c640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410b720 0x7f19340f45b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f19280094b0 tx=0x7f192800ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:14.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.406+0000 7f19227fc640 1 -- 10.20.193.90:0/2918684517 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f192800cac0 con 0x7f193410b720 2026-02-13T21:18:14.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.407+0000 7f19227fc640 1 -- 10.20.193.90:0/2918684517 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f1928004d10 con 0x7f193410b720 2026-02-13T21:18:14.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.407+0000 7f19227fc640 1 -- 10.20.193.90:0/2918684517 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1928005720 con 0x7f193410b720 2026-02-13T21:18:14.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.407+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19340f5490 con 0x7f193410b720 2026-02-13T21:18:14.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.407+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19340f5aa0 con 0x7f193410b720 2026-02-13T21:18:14.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.407+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193410bb30 con 0x7f193410b720 2026-02-13T21:18:14.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.408+0000 7f19227fc640 1 -- 10.20.193.90:0/2918684517 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f19280047a0 con 0x7f193410b720 2026-02-13T21:18:14.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.408+0000 7f19227fc640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1910079650 0x7f1910099b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:14.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.408+0000 7f19227fc640 1 -- 10.20.193.90:0/2918684517 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4784+0+0 (secure 0 0 0) 0x7f192809c800 con 0x7f193410b720 2026-02-13T21:18:14.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.409+0000 7f193937d640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1910079650 0x7f1910099b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:14.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.410+0000 7f193937d640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1910079650 0x7f1910099b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1924002400 tx=0x7f192403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:14.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.411+0000 7f19227fc640 1 -- 10.20.193.90:0/2918684517 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f1928069c10 con 0x7f193410b720 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: from='osd.6 [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:14.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:14 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:14.522 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:18:14 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:18:14.302+0000 7f4dad313640 -1 osd.6 0 waiting for initial osdmap 2026-02-13T21:18:14.522 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:18:14 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:18:14.306+0000 7f4da88fb640 -1 osd.6 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T21:18:14.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:14.523+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f19340ecea0 con 0x7f1910079650 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: from='osd.6 [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:14.540 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:14 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: osd.default does not exist. Creating it now. 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_1'] 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: Saving service osd.default spec with placement trial090 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:15.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:15.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:15 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: osd.default does not exist. Creating it now. 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_1'] 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: Saving service osd.default spec with placement trial090 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:15.753 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:15.754 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:15 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:16.589 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: purged_snaps scrub starts 2026-02-13T21:18:16.589 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: purged_snaps scrub ok 2026-02-13T21:18:16.589 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: Adjusting osd_memory_target on trial090 to 27290M 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: osd.6 [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] boot 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: osdmap e39: 7 total, 7 up, 7 in 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: pgmap v64: 1 pgs: 1 unknown; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a9be97d-270f-4370-bb57-9a4510f4e7f9"} : dispatch 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/1622872933' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a9be97d-270f-4370-bb57-9a4510f4e7f9"} : dispatch 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a9be97d-270f-4370-bb57-9a4510f4e7f9"}]': finished 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:16.590 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:16 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/2653926999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:18:16.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: purged_snaps scrub starts 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: purged_snaps scrub ok 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: Adjusting osd_memory_target on trial090 to 27290M 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: osd.6 [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] boot 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: osdmap e39: 7 total, 7 up, 7 in 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: pgmap v64: 1 pgs: 1 unknown; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a9be97d-270f-4370-bb57-9a4510f4e7f9"} : dispatch 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/1622872933' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a9be97d-270f-4370-bb57-9a4510f4e7f9"} : dispatch 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a9be97d-270f-4370-bb57-9a4510f4e7f9"}]': finished 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:16.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:16 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/2653926999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T21:18:17.920 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:17 trial090 ceph-mon[42877]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T21:18:17.920 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:17.920 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:18:17.920 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T21:18:17.920 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:17.920 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T21:18:17.920 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:17 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:18.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:17 trial012 ceph-mon[37926]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T21:18:18.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:18.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:18:18.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T21:18:18.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:18.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T21:18:18.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:17 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:18.919 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:18 trial090 ceph-mon[42877]: Deploying daemon osd.7 on trial090 2026-02-13T21:18:18.919 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:18 trial090 ceph-mon[42877]: Deploying daemon osd.7 on trial090 2026-02-13T21:18:18.919 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:18 trial090 ceph-mon[42877]: pgmap v67: 1 pgs: 1 peering; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T21:18:19.125 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:18 trial012 ceph-mon[37926]: Deploying daemon osd.7 on trial090 2026-02-13T21:18:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:18 trial012 ceph-mon[37926]: Deploying daemon osd.7 on trial090 2026-02-13T21:18:19.126 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:18 trial012 ceph-mon[37926]: pgmap v67: 1 pgs: 1 peering; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T21:18:20.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:20.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:20 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:20.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:20 trial090 ceph-mon[42877]: pgmap v68: 1 pgs: 1 peering; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T21:18:20.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:20.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:20 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:20.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:20 trial012 ceph-mon[37926]: pgmap v68: 1 pgs: 1 peering; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T21:18:21.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.941+0000 7f19227fc640 1 -- 10.20.193.90:0/2918684517 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f19340ecea0 con 0x7f1910079650 2026-02-13T21:18:21.944 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 7 on host 'trial090' 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1910079650 msgr2=0x7f1910099b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1910079650 0x7f1910099b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1924002400 tx=0x7f192403a040 comp rx=0 tx=0).stop 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410b720 msgr2=0x7f19340f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410b720 0x7f19340f45b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f19280094b0 tx=0x7f192800ede0 comp rx=0 tx=0).stop 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 shutdown_connections 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1910079650 0x7f1910099b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f193410b720 0x7f19340f45b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 --2- 10.20.193.90:0/2918684517 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f193410a5f0 0x7f19340f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:21.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 >> 10.20.193.90:0/2918684517 conn(0x7f19340e7c90 msgr2=0x7f19340ea250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:21.948 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 shutdown_connections 2026-02-13T21:18:21.948 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:21.944+0000 7f193b608640 1 -- 10.20.193.90:0/2918684517 wait complete. 2026-02-13T21:18:21.984 DEBUG:teuthology.orchestra.run.trial090:osd.7> sudo journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.7.service 2026-02-13T21:18:21.986 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2026-02-13T21:18:21.987 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T21:18:22.106 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:22.224 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 -- 10.20.193.12:0/774954797 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410d9b0 msgr2=0x7f59f410ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:22.224 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 --2- 10.20.193.12:0/774954797 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410d9b0 0x7f59f410ddc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f59e4005fd0 tx=0x7f59e402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:22.224 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 -- 10.20.193.12:0/774954797 shutdown_connections 2026-02-13T21:18:22.224 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 --2- 10.20.193.12:0/774954797 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410d9b0 0x7f59f410ddc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:22.224 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 --2- 10.20.193.12:0/774954797 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59f410c880 0x7f59f410ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:22.224 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 -- 10.20.193.12:0/774954797 >> 10.20.193.12:0/774954797 conn(0x7f59f40e9f40 msgr2=0x7f59f410a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 -- 10.20.193.12:0/774954797 shutdown_connections 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 -- 10.20.193.12:0/774954797 wait complete. 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 Processor -- start 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 -- start start 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410c880 0x7f59f40f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59f410d9b0 0x7f59f40f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41516a0 con 0x7f59f410c880 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59fa52b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4151520 con 0x7f59f410d9b0 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59f3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410c880 0x7f59f40f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:22.225 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59f3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410c880 0x7f59f40f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50060/0 (socket says 10.20.193.12:50060) 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.219+0000 7f59f3fff640 1 -- 10.20.193.12:0/1684123612 learned_addr learned my addr 10.20.193.12:0/1684123612 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59f37fe640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59f410d9b0 0x7f59f40f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59f3fff640 1 -- 10.20.193.12:0/1684123612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59f410d9b0 msgr2=0x7f59f40f68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59f3fff640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59f410d9b0 0x7f59f40f68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59f3fff640 1 -- 10.20.193.12:0/1684123612 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f40f74b0 con 0x7f59f410c880 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59f3fff640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410c880 0x7f59f40f6250 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59e000d8d0 tx=0x7f59e000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59f17fa640 1 -- 10.20.193.12:0/1684123612 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f59e0014070 con 0x7f59f410c880 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59f17fa640 1 -- 10.20.193.12:0/1684123612 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f59e00044a0 con 0x7f59f410c880 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f40f77a0 con 0x7f59f410c880 2026-02-13T21:18:22.226 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59f17fa640 1 -- 10.20.193.12:0/1684123612 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f59e0005020 con 0x7f59f410c880 2026-02-13T21:18:22.227 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f40f7d30 con 0x7f59f410c880 2026-02-13T21:18:22.227 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.220+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f410ccf0 con 0x7f59f410c880 2026-02-13T21:18:22.227 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.221+0000 7f59f17fa640 1 -- 10.20.193.12:0/1684123612 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f59e00047a0 con 0x7f59f410c880 2026-02-13T21:18:22.228 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.222+0000 7f59f17fa640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59c80794c0 0x7f59c80999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:22.228 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.222+0000 7f59f17fa640 1 -- 10.20.193.12:0/1684123612 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5179+0+0 (secure 0 0 0) 0x7f59e009c610 con 0x7f59f410c880 2026-02-13T21:18:22.228 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.222+0000 7f59f37fe640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59c80794c0 0x7f59c80999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:22.228 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.222+0000 7f59f37fe640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59c80794c0 0x7f59c80999d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f59e4005b60 tx=0x7f59e403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:22.228 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.225+0000 7f59f17fa640 1 -- 10.20.193.12:0/1684123612 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f59e0069870 con 0x7f59f410c880 2026-02-13T21:18:22.337 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.334+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f59f40f7fe0 con 0x7f59f410c880 2026-02-13T21:18:22.337 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.334+0000 7f59f17fa640 1 -- 10.20.193.12:0/1684123612 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v42) ==== 74+0+130 (secure 0 0 0) 0x7f59e006e970 con 0x7f59f410c880 2026-02-13T21:18:22.338 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:22 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:22.338 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:22 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:22.338 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:22 trial012 ceph-mon[37926]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail; 91 KiB/s, 0 objects/s recovering 2026-02-13T21:18:22.338 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:22 trial012 ceph-mon[37926]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T21:18:22.338 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:22 trial012 ceph-mon[37926]: from='osd.7 [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T21:18:22.338 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:22 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:22.338 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:22 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:22.339 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:22.340 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.335+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59c80794c0 msgr2=0x7f59c80999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:22.340 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.335+0000 7f59fa52b640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59c80794c0 0x7f59c80999d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f59e4005b60 tx=0x7f59e403a040 comp rx=0 tx=0).stop 2026-02-13T21:18:22.340 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.335+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410c880 msgr2=0x7f59f40f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:22.340 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.335+0000 7f59fa52b640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410c880 0x7f59f40f6250 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59e000d8d0 tx=0x7f59e000dda0 comp rx=0 tx=0).stop 2026-02-13T21:18:22.340 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.336+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 shutdown_connections 2026-02-13T21:18:22.340 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.336+0000 7f59fa52b640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59c80794c0 0x7f59c80999d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:22.340 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.336+0000 7f59fa52b640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59f410d9b0 0x7f59f40f68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:22.340 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.336+0000 7f59fa52b640 1 --2- 10.20.193.12:0/1684123612 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f59f410c880 0x7f59f40f6250 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:22.341 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.336+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 >> 10.20.193.12:0/1684123612 conn(0x7f59f40e9f40 msgr2=0x7f59f40ec510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:22.341 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.336+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 shutdown_connections 2026-02-13T21:18:22.341 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:22.336+0000 7f59fa52b640 1 -- 10.20.193.12:0/1684123612 wait complete. 2026-02-13T21:18:22.376 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":42,"num_osds":8,"num_up_osds":7,"osd_up_since":1771017495,"num_in_osds":8,"osd_in_since":1771017495,"num_remapped_pgs":0} 2026-02-13T21:18:22.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:22 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:22.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:22 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:22.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:22 trial090 ceph-mon[42877]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail; 91 KiB/s, 0 objects/s recovering 2026-02-13T21:18:22.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:22 trial090 ceph-mon[42877]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T21:18:22.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:22 trial090 ceph-mon[42877]: from='osd.7 [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T21:18:22.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:22 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:22.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:22 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.377 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T21:18:23.495 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:23.517 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='osd.7 [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1684123612' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.518 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:23 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T21:18:23.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T21:18:23.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:23.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:23.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='osd.7 [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-13T21:18:23.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1684123612' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T21:18:23.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:23.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:23 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:23.523 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:18:23 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:18:23.267+0000 7f0db1121640 -1 osd.7 0 waiting for initial osdmap 2026-02-13T21:18:23.523 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:18:23 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:18:23.271+0000 7f0da8701640 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T21:18:23.613 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.608+0000 7f2ccdef4640 1 -- 10.20.193.12:0/2973404966 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 msgr2=0x7f2cc810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.608+0000 7f2ccdef4640 1 --2- 10.20.193.12:0/2973404966 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 0x7f2cc810bb30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8005fd0 tx=0x7f2cb802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.608+0000 7f2ccdef4640 1 -- 10.20.193.12:0/2973404966 shutdown_connections 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.608+0000 7f2ccdef4640 1 --2- 10.20.193.12:0/2973404966 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 0x7f2cc810bb30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.608+0000 7f2ccdef4640 1 --2- 10.20.193.12:0/2973404966 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cc8054840 0x7f2cc8054cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.608+0000 7f2ccdef4640 1 -- 10.20.193.12:0/2973404966 >> 10.20.193.12:0/2973404966 conn(0x7f2cc80e6b50 msgr2=0x7f2cc8107000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2ccdef4640 1 -- 10.20.193.12:0/2973404966 shutdown_connections 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2ccdef4640 1 -- 10.20.193.12:0/2973404966 wait complete. 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2ccdef4640 1 Processor -- start 2026-02-13T21:18:23.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2ccdef4640 1 -- start start 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2ccdef4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cc8054840 0x7f2cc80f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2ccdef4640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 0x7f2cc80f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2ccdef4640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc814f410 con 0x7f2cc810b720 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2ccdef4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc814f290 con 0x7f2cc8054840 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2cc6ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 0x7f2cc80f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2cc6ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 0x7f2cc80f3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50082/0 (socket says 10.20.193.12:50082) 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2cc6ffd640 1 -- 10.20.193.12:0/1706580775 learned_addr learned my addr 10.20.193.12:0/1706580775 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2cc77fe640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cc8054840 0x7f2cc80f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2cc6ffd640 1 -- 10.20.193.12:0/1706580775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cc8054840 msgr2=0x7f2cc80f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2cc6ffd640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cc8054840 0x7f2cc80f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:23.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.609+0000 7f2cc6ffd640 1 -- 10.20.193.12:0/1706580775 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc80f4000 con 0x7f2cc810b720 2026-02-13T21:18:23.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.610+0000 7f2cc6ffd640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 0x7f2cc80f3410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8005b60 tx=0x7f2cb8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:23.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.610+0000 7f2cc4ff9640 1 -- 10.20.193.12:0/1706580775 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2cb8046070 con 0x7f2cc810b720 2026-02-13T21:18:23.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.610+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc80f4290 con 0x7f2cc810b720 2026-02-13T21:18:23.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.610+0000 7f2cc4ff9640 1 -- 10.20.193.12:0/1706580775 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f2cb8038900 con 0x7f2cc810b720 2026-02-13T21:18:23.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.610+0000 7f2cc4ff9640 1 -- 10.20.193.12:0/1706580775 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2cb8041830 con 0x7f2cc810b720 2026-02-13T21:18:23.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.610+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc80f4790 con 0x7f2cc810b720 2026-02-13T21:18:23.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.610+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc8054cb0 con 0x7f2cc810b720 2026-02-13T21:18:23.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.611+0000 7f2cc4ff9640 1 -- 10.20.193.12:0/1706580775 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f2cb8038470 con 0x7f2cc810b720 2026-02-13T21:18:23.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.612+0000 7f2cc4ff9640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2c9c0793f0 0x7f2c9c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:23.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.612+0000 7f2cc77fe640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2c9c0793f0 0x7f2c9c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:23.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.612+0000 7f2cc4ff9640 1 -- 10.20.193.12:0/1706580775 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5216+0+0 (secure 0 0 0) 0x7f2cb803e070 con 0x7f2cc810b720 2026-02-13T21:18:23.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.612+0000 7f2cc77fe640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2c9c0793f0 0x7f2c9c099900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005de0 tx=0x7f2cb4005d70 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:23.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.615+0000 7f2cc4ff9640 1 -- 10.20.193.12:0/1706580775 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f2cb8050080 con 0x7f2cc810b720 2026-02-13T21:18:23.724 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.721+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2cc80f4cf0 con 0x7f2cc810b720 2026-02-13T21:18:23.724 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.721+0000 7f2cc4ff9640 1 -- 10.20.193.12:0/1706580775 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v43) ==== 74+0+130 (secure 0 0 0) 0x7f2cb808e680 con 0x7f2cc810b720 2026-02-13T21:18:23.724 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:23.725 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2c9c0793f0 msgr2=0x7f2c9c099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2c9c0793f0 0x7f2c9c099900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005de0 tx=0x7f2cb4005d70 comp rx=0 tx=0).stop 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 msgr2=0x7f2cc80f3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 0x7f2cc80f3410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8005b60 tx=0x7f2cb8004290 comp rx=0 tx=0).stop 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 shutdown_connections 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2c9c0793f0 0x7f2c9c099900 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cc810b720 0x7f2cc80f3410 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 --2- 10.20.193.12:0/1706580775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cc8054840 0x7f2cc80f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 >> 10.20.193.12:0/1706580775 conn(0x7f2cc80e6b50 msgr2=0x7f2cc80e90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 shutdown_connections 2026-02-13T21:18:23.726 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:23.722+0000 7f2ccdef4640 1 -- 10.20.193.12:0/1706580775 wait complete. 2026-02-13T21:18:23.762 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1771017495,"num_in_osds":8,"osd_in_since":1771017495,"num_remapped_pgs":0} 2026-02-13T21:18:24.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-13T21:18:24.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T21:18:24.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:24.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:24.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail; 83 KiB/s, 0 objects/s recovering 2026-02-13T21:18:24.273 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1706580775' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:24.274 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:24 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:24.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail; 83 KiB/s, 0 objects/s recovering 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1706580775' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T21:18:24.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:24 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:24.763 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T21:18:24.884 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:24.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.993+0000 7fbcf786a640 1 -- 10.20.193.12:0/3327918582 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 msgr2=0x7fbcf014bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:24.998 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.993+0000 7fbcf786a640 1 --2- 10.20.193.12:0/3327918582 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 0x7fbcf014bed0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbce4005fd0 tx=0x7fbce402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.993+0000 7fbcf786a640 1 -- 10.20.193.12:0/3327918582 shutdown_connections 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.993+0000 7fbcf786a640 1 --2- 10.20.193.12:0/3327918582 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 0x7fbcf014bed0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.993+0000 7fbcf786a640 1 --2- 10.20.193.12:0/3327918582 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcf0108950 0x7fbcf0108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.993+0000 7fbcf786a640 1 -- 10.20.193.12:0/3327918582 >> 10.20.193.12:0/3327918582 conn(0x7fbcf00e62b0 msgr2=0x7fbcf0106760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.993+0000 7fbcf786a640 1 -- 10.20.193.12:0/3327918582 shutdown_connections 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.993+0000 7fbcf786a640 1 -- 10.20.193.12:0/3327918582 wait complete. 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf786a640 1 Processor -- start 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf786a640 1 -- start start 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf786a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcf0108950 0x7fbcf0106760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf786a640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 0x7fbcf0117490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf786a640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf010a340 con 0x7fbcf012bab0 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf786a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf010a1c0 con 0x7fbcf0108950 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf4dde640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 0x7fbcf0117490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf4dde640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 0x7fbcf0117490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50108/0 (socket says 10.20.193.12:50108) 2026-02-13T21:18:24.999 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf4dde640 1 -- 10.20.193.12:0/3988556110 learned_addr learned my addr 10.20.193.12:0/3988556110 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf55df640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcf0108950 0x7fbcf0106760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf4dde640 1 -- 10.20.193.12:0/3988556110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcf0108950 msgr2=0x7fbcf0106760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf4dde640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcf0108950 0x7fbcf0106760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf4dde640 1 -- 10.20.193.12:0/3988556110 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf0117b60 con 0x7fbcf012bab0 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf4dde640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 0x7fbcf0117490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbce4005b60 tx=0x7fbce4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcde7fc640 1 -- 10.20.193.12:0/3988556110 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbce4046070 con 0x7fbcf012bab0 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcde7fc640 1 -- 10.20.193.12:0/3988556110 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fbce4038900 con 0x7fbcf012bab0 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf0117df0 con 0x7fbcf012bab0 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcde7fc640 1 -- 10.20.193.12:0/3988556110 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbce4041830 con 0x7fbcf012bab0 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.994+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf01188c0 con 0x7fbcf012bab0 2026-02-13T21:18:25.000 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.995+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf010ab20 con 0x7fbcf012bab0 2026-02-13T21:18:25.001 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.996+0000 7fbcde7fc640 1 -- 10.20.193.12:0/3988556110 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fbce4038470 con 0x7fbcf012bab0 2026-02-13T21:18:25.001 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.996+0000 7fbcde7fc640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbccc0794c0 0x7fbccc0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:25.001 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.996+0000 7fbcde7fc640 1 -- 10.20.193.12:0/3988556110 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5529+0+0 (secure 0 0 0) 0x7fbce403e070 con 0x7fbcf012bab0 2026-02-13T21:18:25.001 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.996+0000 7fbcf55df640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbccc0794c0 0x7fbccc0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:25.001 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.997+0000 7fbcf55df640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbccc0794c0 0x7fbccc0999d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbce0005fd0 tx=0x7fbce00073d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:25.002 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:24.999+0000 7fbcde7fc640 1 -- 10.20.193.12:0/3988556110 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fbce4050080 con 0x7fbcf012bab0 2026-02-13T21:18:25.114 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.110+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbcf01193b0 con 0x7fbcf012bab0 2026-02-13T21:18:25.114 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.110+0000 7fbcde7fc640 1 -- 10.20.193.12:0/3988556110 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v44) ==== 74+0+130 (secure 0 0 0) 0x7fbce408e540 con 0x7fbcf012bab0 2026-02-13T21:18:25.114 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:25.116 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbccc0794c0 msgr2=0x7fbccc0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.116 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbccc0794c0 0x7fbccc0999d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbce0005fd0 tx=0x7fbce00073d0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.116 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 msgr2=0x7fbcf0117490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 0x7fbcf0117490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbce4005b60 tx=0x7fbce4004290 comp rx=0 tx=0).stop 2026-02-13T21:18:25.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 shutdown_connections 2026-02-13T21:18:25.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbccc0794c0 0x7fbccc0999d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbcf012bab0 0x7fbcf0117490 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 --2- 10.20.193.12:0/3988556110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcf0108950 0x7fbcf0106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 >> 10.20.193.12:0/3988556110 conn(0x7fbcf00e62b0 msgr2=0x7fbcf010dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:25.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 shutdown_connections 2026-02-13T21:18:25.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.112+0000 7fbcf786a640 1 -- 10.20.193.12:0/3988556110 wait complete. 2026-02-13T21:18:25.155 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1771017504,"num_in_osds":8,"osd_in_since":1771017495,"num_remapped_pgs":1} 2026-02-13T21:18:25.156 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T21:18:25.275 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:25.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: purged_snaps scrub starts 2026-02-13T21:18:25.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: purged_snaps scrub ok 2026-02-13T21:18:25.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: Detected new or changed devices on trial090 2026-02-13T21:18:25.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: Adjusting osd_memory_target on trial090 to 20467M 2026-02-13T21:18:25.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:25.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: osd.7 [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] boot 2026-02-13T21:18:25.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: osdmap e44: 8 total, 8 up, 8 in 2026-02-13T21:18:25.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:25.377 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:25 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3988556110' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T21:18:25.397 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 -- 10.20.193.12:0/928388462 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 msgr2=0x7f72a01507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 --2- 10.20.193.12:0/928388462 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 0x7f72a01507e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7294005fd0 tx=0x7f729402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 -- 10.20.193.12:0/928388462 shutdown_connections 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 --2- 10.20.193.12:0/928388462 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 0x7f72a01507e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 --2- 10.20.193.12:0/928388462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72a010b770 0x7f72a010bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 -- 10.20.193.12:0/928388462 >> 10.20.193.12:0/928388462 conn(0x7f72a00e7050 msgr2=0x7f72a01074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 -- 10.20.193.12:0/928388462 shutdown_connections 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 -- 10.20.193.12:0/928388462 wait complete. 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 Processor -- start 2026-02-13T21:18:25.398 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.392+0000 7f72a83d9640 1 -- start start 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a83d9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72a010b770 0x7f72a00f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a83d9640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 0x7f72a00f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a83d9640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0153ae0 con 0x7f72a010c1a0 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a83d9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0153960 con 0x7f72a010b770 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a594d640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 0x7f72a00f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a594d640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 0x7f72a00f4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50130/0 (socket says 10.20.193.12:50130) 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a594d640 1 -- 10.20.193.12:0/2997045674 learned_addr learned my addr 10.20.193.12:0/2997045674 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a614e640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72a010b770 0x7f72a00f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a594d640 1 -- 10.20.193.12:0/2997045674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72a010b770 msgr2=0x7f72a00f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a594d640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72a010b770 0x7f72a00f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a594d640 1 -- 10.20.193.12:0/2997045674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a00fa1c0 con 0x7f72a010c1a0 2026-02-13T21:18:25.399 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a594d640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 0x7f72a00f4f00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7294009510 tx=0x7f7294004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:25.400 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72877fe640 1 -- 10.20.193.12:0/2997045674 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7294046070 con 0x7f72a010c1a0 2026-02-13T21:18:25.400 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72877fe640 1 -- 10.20.193.12:0/2997045674 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f72940027a0 con 0x7f72a010c1a0 2026-02-13T21:18:25.400 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72877fe640 1 -- 10.20.193.12:0/2997045674 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7294041630 con 0x7f72a010c1a0 2026-02-13T21:18:25.400 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a00fa450 con 0x7f72a010c1a0 2026-02-13T21:18:25.400 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.393+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a00faa00 con 0x7f72a010c1a0 2026-02-13T21:18:25.400 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.394+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a0054a90 con 0x7f72a010c1a0 2026-02-13T21:18:25.401 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.395+0000 7f72877fe640 1 -- 10.20.193.12:0/2997045674 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f7294038990 con 0x7f72a010c1a0 2026-02-13T21:18:25.401 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.395+0000 7f72877fe640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f727c0794c0 0x7f727c0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:25.401 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.395+0000 7f72877fe640 1 -- 10.20.193.12:0/2997045674 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5496+0+0 (secure 0 0 0) 0x7f729403e070 con 0x7f72a010c1a0 2026-02-13T21:18:25.401 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.395+0000 7f72a614e640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f727c0794c0 0x7f727c0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:25.401 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.395+0000 7f72a614e640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f727c0794c0 0x7f727c0999d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72a00fb250 tx=0x7f7290005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:25.402 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.398+0000 7f72877fe640 1 -- 10.20.193.12:0/2997045674 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f7294050080 con 0x7f72a010c1a0 2026-02-13T21:18:25.410 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: purged_snaps scrub starts 2026-02-13T21:18:25.410 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: purged_snaps scrub ok 2026-02-13T21:18:25.410 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: Detected new or changed devices on trial090 2026-02-13T21:18:25.410 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: Adjusting osd_memory_target on trial090 to 20467M 2026-02-13T21:18:25.410 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:25.410 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: osd.7 [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] boot 2026-02-13T21:18:25.410 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: osdmap e44: 8 total, 8 up, 8 in 2026-02-13T21:18:25.411 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T21:18:25.411 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:25 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3988556110' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T21:18:25.507 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.504+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72a00facb0 con 0x7f72a010c1a0 2026-02-13T21:18:25.508 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.504+0000 7f72877fe640 1 -- 10.20.193.12:0/2997045674 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+13879 (secure 0 0 0) 0x7f729408e4e0 con 0x7f72a010c1a0 2026-02-13T21:18:25.509 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:25.509 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":45,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","created":"2026-02-13T21:16:19.758726+0000","modified":"2026-02-13T21:18:25.269163+0000","last_up_change":"2026-02-13T21:18:24.265543+0000","last_in_change":"2026-02-13T21:18:15.652245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T21:17:45.821822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de74b69e-730a-4162-a3cc-3daa616bf84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6802","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6803","nonce":1211901108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6804","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6805","nonce":1211901108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6808","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6809","nonce":1211901108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6806","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6807","nonce":1211901108}]},"public_addr":"10.20.193.12:6803/1211901108","cluster_addr":"10.20.193.12:6805/1211901108","heartbeat_back_addr":"10.20.193.12:6809/1211901108","heartbeat_front_addr":"10.20.193.12:6807/1211901108","state":["exists","up"]},{"osd":1,"uuid":"6118d6e3-09c9-4db8-b217-1c3327e2ea30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6810","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6811","nonce":2390579753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6812","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6813","nonce":2390579753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6816","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6817","nonce":2390579753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6814","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6815","nonce":2390579753}]},"public_addr":"10.20.193.12:6811/2390579753","cluster_addr":"10.20.193.12:6813/2390579753","heartbeat_back_addr":"10.20.193.12:6817/2390579753","heartbeat_front_addr":"10.20.193.12:6815/2390579753","state":["exists","up"]},{"osd":2,"uuid":"752d80ce-ee90-4e8a-9ccb-626e1ff2ce72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6818","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6819","nonce":1263676438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6820","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6821","nonce":1263676438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6824","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6825","nonce":1263676438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6822","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6823","nonce":1263676438}]},"public_addr":"10.20.193.12:6819/1263676438","cluster_addr":"10.20.193.12:6821/1263676438","heartbeat_back_addr":"10.20.193.12:6825/1263676438","heartbeat_front_addr":"10.20.193.12:6823/1263676438","state":["exists","up"]},{"osd":3,"uuid":"2e4c26bc-c190-453c-bd22-452337fb54fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6826","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6827","nonce":1782630321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6828","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6829","nonce":1782630321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6832","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6833","nonce":1782630321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6830","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6831","nonce":1782630321}]},"public_addr":"10.20.193.12:6827/1782630321","cluster_addr":"10.20.193.12:6829/1782630321","heartbeat_back_addr":"10.20.193.12:6833/1782630321","heartbeat_front_addr":"10.20.193.12:6831/1782630321","state":["exists","up"]},{"osd":4,"uuid":"2a92779e-4460-41dc-b18a-4c646ac46091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6801","nonce":1546978354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6803","nonce":1546978354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6807","nonce":1546978354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6805","nonce":1546978354}]},"public_addr":"10.20.193.90:6801/1546978354","cluster_addr":"10.20.193.90:6803/1546978354","heartbeat_back_addr":"10.20.193.90:6807/1546978354","heartbeat_front_addr":"10.20.193.90:6805/1546978354","state":["exists","up"]},{"osd":5,"uuid":"40f7e047-3d3d-4bd2-9964-d29a3ff11482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6809","nonce":2430801346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6811","nonce":2430801346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6815","nonce":2430801346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6813","nonce":2430801346}]},"public_addr":"10.20.193.90:6809/2430801346","cluster_addr":"10.20.193.90:6811/2430801346","heartbeat_back_addr":"10.20.193.90:6815/2430801346","heartbeat_front_addr":"10.20.193.90:6813/2430801346","state":["exists","up"]},{"osd":6,"uuid":"5837ab08-fa7e-4cc5-bb99-8c046a23cb8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6817","nonce":391511610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6819","nonce":391511610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6823","nonce":391511610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6821","nonce":391511610}]},"public_addr":"10.20.193.90:6817/391511610","cluster_addr":"10.20.193.90:6819/391511610","heartbeat_back_addr":"10.20.193.90:6823/391511610","heartbeat_front_addr":"10.20.193.90:6821/391511610","state":["exists","up"]},{"osd":7,"uuid":"3a9be97d-270f-4370-bb57-9a4510f4e7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6825","nonce":1694034982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6827","nonce":1694034982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6831","nonce":1694034982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6829","nonce":1694034982}]},"public_addr":"10.20.193.90:6825/1694034982","cluster_addr":"10.20.193.90:6827/1694034982","heartbeat_back_addr":"10.20.193.90:6831/1694034982","heartbeat_front_addr":"10.20.193.90:6829/1694034982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:28.184825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:35.247079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:42.366420+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:49.338130+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:57.851801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:06.994774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:13.782179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:22.858730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.12:0/1300378024":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/3296163882":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6801/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/172285562":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6800/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3542302382":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/72325951":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3948096534":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3481816594":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2322493062":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2357723980":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6800/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/3800148741":"2026-02-14T21:17:01.611190+0000","10.20.193.12:6800/3481816594":"2026-02-14T21:17:01.611190+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T21:18:25.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f727c0794c0 msgr2=0x7f727c0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f727c0794c0 0x7f727c0999d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72a00fb250 tx=0x7f7290005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:25.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 msgr2=0x7f72a00f4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.510 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 0x7f72a00f4f00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7294009510 tx=0x7f7294004290 comp rx=0 tx=0).stop 2026-02-13T21:18:25.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 shutdown_connections 2026-02-13T21:18:25.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f727c0794c0 0x7f727c0999d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f72a010c1a0 0x7f72a00f4f00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 --2- 10.20.193.12:0/2997045674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72a010b770 0x7f72a00f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 >> 10.20.193.12:0/2997045674 conn(0x7f72a00e7050 msgr2=0x7f72a00eef50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:25.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 shutdown_connections 2026-02-13T21:18:25.511 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.505+0000 7f72a83d9640 1 -- 10.20.193.12:0/2997045674 wait complete. 2026-02-13T21:18:25.547 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T21:17:45.821822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T21:18:25.547 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T21:18:25.665 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:25.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.774+0000 7ff1a26f1640 1 -- 10.20.193.12:0/1844685577 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 msgr2=0x7ff19c1507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.774+0000 7ff1a26f1640 1 --2- 10.20.193.12:0/1844685577 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 0x7ff19c1507e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff18c005fd0 tx=0x7ff18c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 -- 10.20.193.12:0/1844685577 shutdown_connections 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 --2- 10.20.193.12:0/1844685577 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 0x7ff19c1507e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 --2- 10.20.193.12:0/1844685577 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff19c10b770 0x7ff19c10bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 -- 10.20.193.12:0/1844685577 >> 10.20.193.12:0/1844685577 conn(0x7ff19c0e7050 msgr2=0x7ff19c1074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 -- 10.20.193.12:0/1844685577 shutdown_connections 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 -- 10.20.193.12:0/1844685577 wait complete. 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 Processor -- start 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 -- start start 2026-02-13T21:18:25.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff19c10b770 0x7ff19c0f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 0x7ff19c0f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c153ae0 con 0x7ff19c10c1a0 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff1a26f1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c153960 con 0x7ff19c10b770 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff19b7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 0x7ff19c0f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff19b7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 0x7ff19c0f7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50146/0 (socket says 10.20.193.12:50146) 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.775+0000 7ff19b7fe640 1 -- 10.20.193.12:0/2580335949 learned_addr learned my addr 10.20.193.12:0/2580335949 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff19bfff640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff19c10b770 0x7ff19c0f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff19b7fe640 1 -- 10.20.193.12:0/2580335949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff19c10b770 msgr2=0x7ff19c0f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff19b7fe640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff19c10b770 0x7ff19c0f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff19b7fe640 1 -- 10.20.193.12:0/2580335949 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c0fc4d0 con 0x7ff19c10c1a0 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff19b7fe640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 0x7ff19c0f7210 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009510 tx=0x7ff18c002bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:25.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff1997fa640 1 -- 10.20.193.12:0/2580335949 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ff18c046070 con 0x7ff19c10c1a0 2026-02-13T21:18:25.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19c0fc760 con 0x7ff19c10c1a0 2026-02-13T21:18:25.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff1997fa640 1 -- 10.20.193.12:0/2580335949 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7ff18c004420 con 0x7ff19c10c1a0 2026-02-13T21:18:25.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff1997fa640 1 -- 10.20.193.12:0/2580335949 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ff18c038e60 con 0x7ff19c10c1a0 2026-02-13T21:18:25.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19c0fcc90 con 0x7ff19c10c1a0 2026-02-13T21:18:25.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.776+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19c054a90 con 0x7ff19c10c1a0 2026-02-13T21:18:25.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.777+0000 7ff1997fa640 1 -- 10.20.193.12:0/2580335949 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7ff18c038470 con 0x7ff19c10c1a0 2026-02-13T21:18:25.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.778+0000 7ff1997fa640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff1700793f0 0x7ff170099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:25.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.778+0000 7ff19bfff640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff1700793f0 0x7ff170099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:25.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.778+0000 7ff1997fa640 1 -- 10.20.193.12:0/2580335949 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5496+0+0 (secure 0 0 0) 0x7ff18c03e070 con 0x7ff19c10c1a0 2026-02-13T21:18:25.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.778+0000 7ff19bfff640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff1700793f0 0x7ff170099900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0fd560 tx=0x7ff188009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:25.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.781+0000 7ff1997fa640 1 -- 10.20.193.12:0/2580335949 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7ff18c08e2f0 con 0x7ff19c10c1a0 2026-02-13T21:18:25.888 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.885+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff19c10bb80 con 0x7ff19c10c1a0 2026-02-13T21:18:25.889 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.885+0000 7ff1997fa640 1 -- 10.20.193.12:0/2580335949 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) ==== 93+0+10 (secure 0 0 0) 0x7ff18c084030 con 0x7ff19c10c1a0 2026-02-13T21:18:25.889 INFO:teuthology.orchestra.run.trial012.stdout:pg_num: 1 2026-02-13T21:18:25.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff1700793f0 msgr2=0x7ff170099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff1700793f0 0x7ff170099900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0fd560 tx=0x7ff188009260 comp rx=0 tx=0).stop 2026-02-13T21:18:25.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 msgr2=0x7ff19c0f7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:25.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 0x7ff19c0f7210 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009510 tx=0x7ff18c002bf0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 shutdown_connections 2026-02-13T21:18:25.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff1700793f0 0x7ff170099900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff19c10c1a0 0x7ff19c0f7210 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 --2- 10.20.193.12:0/2580335949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff19c10b770 0x7ff19c0f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:25.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 >> 10.20.193.12:0/2580335949 conn(0x7ff19c0e7050 msgr2=0x7ff19c10af20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:25.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 shutdown_connections 2026-02-13T21:18:25.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:25.886+0000 7ff1a26f1640 1 -- 10.20.193.12:0/2580335949 wait complete. 2026-02-13T21:18:25.927 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T21:18:25.928 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T21:18:26.044 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:26.164 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.155+0000 7f12067ad640 1 -- 10.20.193.12:0/2262067040 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 msgr2=0x7f120010df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:26.164 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.155+0000 7f12067ad640 1 --2- 10.20.193.12:0/2262067040 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 0x7f120010df60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f11f0005fd0 tx=0x7f11f002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.164 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.155+0000 7f12067ad640 1 -- 10.20.193.12:0/2262067040 shutdown_connections 2026-02-13T21:18:26.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.155+0000 7f12067ad640 1 --2- 10.20.193.12:0/2262067040 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 0x7f120010df60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.155+0000 7f12067ad640 1 --2- 10.20.193.12:0/2262067040 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f120010ca20 0x7f120010ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.155+0000 7f12067ad640 1 -- 10.20.193.12:0/2262067040 >> 10.20.193.12:0/2262067040 conn(0x7f12000ea100 msgr2=0x7f120010a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:26.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.155+0000 7f12067ad640 1 -- 10.20.193.12:0/2262067040 shutdown_connections 2026-02-13T21:18:26.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.155+0000 7f12067ad640 1 -- 10.20.193.12:0/2262067040 wait complete. 2026-02-13T21:18:26.166 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f12067ad640 1 Processor -- start 2026-02-13T21:18:26.166 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f12067ad640 1 -- start start 2026-02-13T21:18:26.166 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f12067ad640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f120010ca20 0x7f12000f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:26.166 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f12067ad640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 0x7f12000f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:26.166 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f12067ad640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12001516b0 con 0x7f120010db50 2026-02-13T21:18:26.166 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f12067ad640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1200151530 con 0x7f120010ca20 2026-02-13T21:18:26.167 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11ff7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 0x7f12000f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:26.167 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11ff7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 0x7f12000f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50164/0 (socket says 10.20.193.12:50164) 2026-02-13T21:18:26.167 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11ff7fe640 1 -- 10.20.193.12:0/540919533 learned_addr learned my addr 10.20.193.12:0/540919533 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:26.167 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11fffff640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f120010ca20 0x7f12000f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:26.167 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11ff7fe640 1 -- 10.20.193.12:0/540919533 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f120010ca20 msgr2=0x7f12000f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:26.167 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11ff7fe640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f120010ca20 0x7f12000f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.168 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11ff7fe640 1 -- 10.20.193.12:0/540919533 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12000f7590 con 0x7f120010db50 2026-02-13T21:18:26.168 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11ff7fe640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 0x7f12000f69a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f11f0005b60 tx=0x7f11f0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:26.168 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11fd7fa640 1 -- 10.20.193.12:0/540919533 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f11f0046070 con 0x7f120010db50 2026-02-13T21:18:26.168 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f11fd7fa640 1 -- 10.20.193.12:0/540919533 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f11f0038900 con 0x7f120010db50 2026-02-13T21:18:26.168 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.156+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12000f7820 con 0x7f120010db50 2026-02-13T21:18:26.168 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.157+0000 7f11fd7fa640 1 -- 10.20.193.12:0/540919533 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f11f0041830 con 0x7f120010db50 2026-02-13T21:18:26.168 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.157+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12000f7da0 con 0x7f120010db50 2026-02-13T21:18:26.169 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.157+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120010ce90 con 0x7f120010db50 2026-02-13T21:18:26.169 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.158+0000 7f11fd7fa640 1 -- 10.20.193.12:0/540919533 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f11f0038470 con 0x7f120010db50 2026-02-13T21:18:26.169 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.158+0000 7f11fd7fa640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f11d40794c0 0x7f11d40999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:26.169 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.159+0000 7f11fffff640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f11d40794c0 0x7f11d40999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:26.169 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.159+0000 7f11fd7fa640 1 -- 10.20.193.12:0/540919533 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5496+0+0 (secure 0 0 0) 0x7f11f003e070 con 0x7f120010db50 2026-02-13T21:18:26.169 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.159+0000 7f11fffff640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f11d40794c0 0x7f11d40999d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11ec004770 tx=0x7f11ec005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:26.170 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.161+0000 7f11fd7fa640 1 -- 10.20.193.12:0/540919533 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f11f0050080 con 0x7f120010db50 2026-02-13T21:18:26.313 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.309+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f12000f8660 con 0x7f120010db50 2026-02-13T21:18:26.314 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.311+0000 7f11fd7fa640 1 -- 10.20.193.12:0/540919533 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) ==== 170+0+59 (secure 0 0 0) 0x7f11f008e5f0 con 0x7f120010db50 2026-02-13T21:18:26.315 INFO:teuthology.orchestra.run.trial012.stdout:[client.0] 2026-02-13T21:18:26.315 INFO:teuthology.orchestra.run.trial012.stdout: key = AQAilY9pkgyWEhAATueLYPrQjollO0XISeldRA== 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f11d40794c0 msgr2=0x7f11d40999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f11d40794c0 0x7f11d40999d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11ec004770 tx=0x7f11ec005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 msgr2=0x7f12000f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 0x7f12000f69a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f11f0005b60 tx=0x7f11f0004290 comp rx=0 tx=0).stop 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 shutdown_connections 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f11d40794c0 0x7f11d40999d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f120010db50 0x7f12000f69a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 --2- 10.20.193.12:0/540919533 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f120010ca20 0x7f12000f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 >> 10.20.193.12:0/540919533 conn(0x7f12000ea100 msgr2=0x7f12000ec5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 shutdown_connections 2026-02-13T21:18:26.316 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:26.313+0000 7f12067ad640 1 -- 10.20.193.12:0/540919533 wait complete. 2026-02-13T21:18:26.368 DEBUG:teuthology.orchestra.run.trial012:> set -ex 2026-02-13T21:18:26.368 DEBUG:teuthology.orchestra.run.trial012:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T21:18:26.368 DEBUG:teuthology.orchestra.run.trial012:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T21:18:26.403 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T21:18:26.525 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial090/config 2026-02-13T21:18:26.549 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:26 trial090 ceph-mon[42877]: osdmap e45: 8 total, 8 up, 8 in 2026-02-13T21:18:26.549 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:26 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2997045674' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:26.549 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:26 trial090 ceph-mon[42877]: pgmap v75: 1 pgs: 1 remapped+peering; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:26.549 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:26 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:26.549 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:26 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:26.550 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:26 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2580335949' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T21:18:26.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:26 trial012 ceph-mon[37926]: osdmap e45: 8 total, 8 up, 8 in 2026-02-13T21:18:26.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:26 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2997045674' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:26.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:26 trial012 ceph-mon[37926]: pgmap v75: 1 pgs: 1 remapped+peering; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:26.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:26 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:26.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:26 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:26.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:26 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2580335949' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T21:18:26.648 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.643+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2419731610 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 msgr2=0x7f8a60109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:26.648 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.643+0000 7f8a67d1b640 1 --2- 10.20.193.90:0/2419731610 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 0x7f8a60109a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005fd0 tx=0x7f8a5002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.648 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2419731610 shutdown_connections 2026-02-13T21:18:26.648 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 --2- 10.20.193.90:0/2419731610 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8a6010a750 0x7f8a6010ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.648 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 --2- 10.20.193.90:0/2419731610 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 0x7f8a60109a90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.648 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2419731610 >> 10.20.193.90:0/2419731610 conn(0x7f8a600e6cc0 msgr2=0x7f8a60107170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2419731610 shutdown_connections 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2419731610 wait complete. 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 Processor -- start 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 -- start start 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 0x7f8a600f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8a6010a750 0x7f8a600f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6014e2b0 con 0x7f8a6010a750 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a67d1b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6014e130 con 0x7f8a60109620 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a65a90640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 0x7f8a600f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a65a90640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 0x7f8a600f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52068/0 (socket says 10.20.193.90:52068) 2026-02-13T21:18:26.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a65a90640 1 -- 10.20.193.90:0/2670402933 learned_addr learned my addr 10.20.193.90:0/2670402933 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a6528f640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8a6010a750 0x7f8a600f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a65a90640 1 -- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8a6010a750 msgr2=0x7f8a600f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a65a90640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8a6010a750 0x7f8a600f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.644+0000 7f8a65a90640 1 -- 10.20.193.90:0/2670402933 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600f7580 con 0x7f8a60109620 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.645+0000 7f8a65a90640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 0x7f8a600f6320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005b60 tx=0x7f8a50004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.645+0000 7f8a4effd640 1 -- 10.20.193.90:0/2670402933 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8a50046070 con 0x7f8a60109620 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.645+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a600f7810 con 0x7f8a60109620 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.645+0000 7f8a4effd640 1 -- 10.20.193.90:0/2670402933 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f8a50038900 con 0x7f8a60109620 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.645+0000 7f8a4effd640 1 -- 10.20.193.90:0/2670402933 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8a50041830 con 0x7f8a60109620 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.645+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a600f7d90 con 0x7f8a60109620 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.645+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6010ab60 con 0x7f8a60109620 2026-02-13T21:18:26.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.646+0000 7f8a4effd640 1 -- 10.20.193.90:0/2670402933 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f8a50038470 con 0x7f8a60109620 2026-02-13T21:18:26.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.647+0000 7f8a4effd640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8a3c0793f0 0x7f8a3c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:26.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.647+0000 7f8a4effd640 1 -- 10.20.193.90:0/2670402933 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f8a5003e070 con 0x7f8a60109620 2026-02-13T21:18:26.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.647+0000 7f8a6528f640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8a3c0793f0 0x7f8a3c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:26.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.647+0000 7f8a6528f640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8a3c0793f0 0x7f8a3c099900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a54004770 tx=0x7f8a54005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:26.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.650+0000 7f8a4effd640 1 -- 10.20.193.90:0/2670402933 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f8a50050080 con 0x7f8a60109620 2026-02-13T21:18:26.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.802+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8a600f8650 con 0x7f8a60109620 2026-02-13T21:18:26.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.807+0000 7f8a4effd640 1 -- 10.20.193.90:0/2670402933 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) ==== 170+0+59 (secure 0 0 0) 0x7f8a5008e680 con 0x7f8a60109620 2026-02-13T21:18:26.808 INFO:teuthology.orchestra.run.trial090.stdout:[client.1] 2026-02-13T21:18:26.809 INFO:teuthology.orchestra.run.trial090.stdout: key = AQAilY9pMjblLxAAcGd9V8P0EKRll8dxCKi40Q== 2026-02-13T21:18:26.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8a3c0793f0 msgr2=0x7f8a3c099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:26.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8a3c0793f0 0x7f8a3c099900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a54004770 tx=0x7f8a54005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 msgr2=0x7f8a600f6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 0x7f8a600f6320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005b60 tx=0x7f8a50004290 comp rx=0 tx=0).stop 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 shutdown_connections 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8a3c0793f0 0x7f8a3c099900 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8a6010a750 0x7f8a600f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 --2- 10.20.193.90:0/2670402933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a60109620 0x7f8a600f6320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 >> 10.20.193.90:0/2670402933 conn(0x7f8a600e6cc0 msgr2=0x7f8a600e8100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 shutdown_connections 2026-02-13T21:18:26.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-13T21:18:26.808+0000 7f8a67d1b640 1 -- 10.20.193.90:0/2670402933 wait complete. 2026-02-13T21:18:26.851 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-13T21:18:26.852 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-13T21:18:26.852 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-13T21:18:26.888 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T21:18:27.006 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:27.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.117+0000 7f0569b78640 1 -- 10.20.193.12:0/2385685653 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0564112610 msgr2=0x7f0564112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.117+0000 7f0569b78640 1 --2- 10.20.193.12:0/2385685653 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0564112610 0x7f0564112a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0554005fd0 tx=0x7f055402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.117+0000 7f0569b78640 1 -- 10.20.193.12:0/2385685653 shutdown_connections 2026-02-13T21:18:27.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.117+0000 7f0569b78640 1 --2- 10.20.193.12:0/2385685653 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f0564112610 0x7f0564112a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.117+0000 7f0569b78640 1 --2- 10.20.193.12:0/2385685653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f056410ccd0 0x7f056410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.117+0000 7f0569b78640 1 -- 10.20.193.12:0/2385685653 >> 10.20.193.12:0/2385685653 conn(0x7f05640ea470 msgr2=0x7f056410a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.117+0000 7f0569b78640 1 -- 10.20.193.12:0/2385685653 shutdown_connections 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.117+0000 7f0569b78640 1 -- 10.20.193.12:0/2385685653 wait complete. 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0569b78640 1 Processor -- start 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0569b78640 1 -- start start 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0569b78640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f056410ccd0 0x7f056411b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0569b78640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0564112610 0x7f056411bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0569b78640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0564155db0 con 0x7f056410ccd0 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0569b78640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0564155c30 con 0x7f0564112610 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f05637fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f056410ccd0 0x7f056411b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f05637fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f056410ccd0 0x7f056411b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50182/0 (socket says 10.20.193.12:50182) 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f05637fe640 1 -- 10.20.193.12:0/385418972 learned_addr learned my addr 10.20.193.12:0/385418972 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0562ffd640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0564112610 0x7f056411bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f05637fe640 1 -- 10.20.193.12:0/385418972 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0564112610 msgr2=0x7f056411bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f05637fe640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0564112610 0x7f056411bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f05637fe640 1 -- 10.20.193.12:0/385418972 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0564121010 con 0x7f056410ccd0 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0562ffd640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0564112610 0x7f056411bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f05637fe640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f056410ccd0 0x7f056411b7d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f055000d8d0 tx=0x7f055000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0560ff9640 1 -- 10.20.193.12:0/385418972 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0550014070 con 0x7f056410ccd0 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0564121300 con 0x7f056410ccd0 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0560ff9640 1 -- 10.20.193.12:0/385418972 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f055000bcd0 con 0x7f056410ccd0 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0560ff9640 1 -- 10.20.193.12:0/385418972 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0550002cc0 con 0x7f056410ccd0 2026-02-13T21:18:27.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.118+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0564121910 con 0x7f056410ccd0 2026-02-13T21:18:27.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.119+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056410df50 con 0x7f056410ccd0 2026-02-13T21:18:27.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.120+0000 7f0560ff9640 1 -- 10.20.193.12:0/385418972 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f055000b840 con 0x7f056410ccd0 2026-02-13T21:18:27.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.120+0000 7f0560ff9640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f05380793f0 0x7f0538099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.120+0000 7f0560ff9640 1 -- 10.20.193.12:0/385418972 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f055009c820 con 0x7f056410ccd0 2026-02-13T21:18:27.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.120+0000 7f0562ffd640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f05380793f0 0x7f0538099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.121+0000 7f0562ffd640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f05380793f0 0x7f0538099900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0554009900 tx=0x7f055403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:27.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.123+0000 7f0560ff9640 1 -- 10.20.193.12:0/385418972 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f0550069940 con 0x7f056410ccd0 2026-02-13T21:18:27.231 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.228+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f0564121c20 con 0x7f056410ccd0 2026-02-13T21:18:27.232 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.228+0000 7f0560ff9640 1 -- 10.20.193.12:0/385418972 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v41) ==== 86+0+188 (secure 0 0 0) 0x7f055006ea40 con 0x7f056410ccd0 2026-02-13T21:18:27.232 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f05380793f0 msgr2=0x7f0538099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f05380793f0 0x7f0538099900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0554009900 tx=0x7f055403a040 comp rx=0 tx=0).stop 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f056410ccd0 msgr2=0x7f056411b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f056410ccd0 0x7f056411b7d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f055000d8d0 tx=0x7f055000dda0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 shutdown_connections 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f05380793f0 0x7f0538099900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0564112610 0x7f056411bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 --2- 10.20.193.12:0/385418972 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f056410ccd0 0x7f056411b7d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 >> 10.20.193.12:0/385418972 conn(0x7f05640ea470 msgr2=0x7f056410a890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 shutdown_connections 2026-02-13T21:18:27.233 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.229+0000 7f0569b78640 1 -- 10.20.193.12:0/385418972 wait complete. 2026-02-13T21:18:27.291 INFO:teuthology.orchestra.run.trial012.stdout:[{"version":41,"timestamp":"2026-02-13T21:18:23.986242+0000","name":"","changes":[{"name":"osd/host:trial090/osd_memory_target","previous_value":"28616075810","new_value":"21462056857"}]}] 2026-02-13T21:18:27.291 INFO:tasks.ceph_manager:config epoch is 41 2026-02-13T21:18:27.291 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T21:18:27.291 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T21:18:27.291 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T21:18:27.408 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:27.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 -- 10.20.193.12:0/2268626037 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 msgr2=0x7fc1541129d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 --2- 10.20.193.12:0/2268626037 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 0x7fc1541129d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc148005fd0 tx=0x7fc14802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 -- 10.20.193.12:0/2268626037 shutdown_connections 2026-02-13T21:18:27.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 --2- 10.20.193.12:0/2268626037 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 0x7fc1541129d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 --2- 10.20.193.12:0/2268626037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc15410cc80 0x7fc15410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 -- 10.20.193.12:0/2268626037 >> 10.20.193.12:0/2268626037 conn(0x7fc1540ea4b0 msgr2=0x7fc15410a900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:27.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 -- 10.20.193.12:0/2268626037 shutdown_connections 2026-02-13T21:18:27.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 -- 10.20.193.12:0/2268626037 wait complete. 2026-02-13T21:18:27.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 Processor -- start 2026-02-13T21:18:27.523 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.518+0000 7fc15b386640 1 -- start start 2026-02-13T21:18:27.524 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:27 trial012 ceph-mon[37926]: osdmap e46: 8 total, 8 up, 8 in 2026-02-13T21:18:27.524 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:27 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/540919533' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T21:18:27.524 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:27 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/540919533' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T21:18:27.524 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:27 trial012 ceph-mon[37926]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T21:18:27.524 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:27 trial012 ceph-mon[37926]: from='client.? 10.20.193.90:0/2670402933' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T21:18:27.524 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:27 trial012 ceph-mon[37926]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T21:18:27.524 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:27 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/385418972' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T21:18:27.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc15b386640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc15410cc80 0x7fc15411adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc15b386640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 0x7fc15411b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc15b386640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc154155d60 con 0x7fc1541125c0 2026-02-13T21:18:27.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc15b386640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc154155be0 con 0x7fc15410cc80 2026-02-13T21:18:27.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1588fa640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 0x7fc15411b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1588fa640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 0x7fc15411b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50198/0 (socket says 10.20.193.12:50198) 2026-02-13T21:18:27.527 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1588fa640 1 -- 10.20.193.12:0/726255605 learned_addr learned my addr 10.20.193.12:0/726255605 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1590fb640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc15410cc80 0x7fc15411adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1588fa640 1 -- 10.20.193.12:0/726255605 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc15410cc80 msgr2=0x7fc15411adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1588fa640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc15410cc80 0x7fc15411adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1588fa640 1 -- 10.20.193.12:0/726255605 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc154120600 con 0x7fc1541125c0 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1588fa640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 0x7fc15411b340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc148002db0 tx=0x7fc148002de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1427fc640 1 -- 10.20.193.12:0/726255605 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc148046070 con 0x7fc1541125c0 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1427fc640 1 -- 10.20.193.12:0/726255605 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fc148004560 con 0x7fc1541125c0 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc1427fc640 1 -- 10.20.193.12:0/726255605 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc1480416c0 con 0x7fc1541125c0 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc154120890 con 0x7fc1541125c0 2026-02-13T21:18:27.528 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.519+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc154120e40 con 0x7fc1541125c0 2026-02-13T21:18:27.529 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.520+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15410df00 con 0x7fc1541125c0 2026-02-13T21:18:27.529 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.521+0000 7fc1427fc640 1 -- 10.20.193.12:0/726255605 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fc148038a20 con 0x7fc1541125c0 2026-02-13T21:18:27.529 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.521+0000 7fc1427fc640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc1300794c0 0x7fc1300999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.529 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.521+0000 7fc1590fb640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc1300794c0 0x7fc1300999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.529 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.521+0000 7fc1427fc640 1 -- 10.20.193.12:0/726255605 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fc14803e070 con 0x7fc1541125c0 2026-02-13T21:18:27.529 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.521+0000 7fc1590fb640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc1300794c0 0x7fc1300999d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc154121690 tx=0x7fc144005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:27.530 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.524+0000 7fc1427fc640 1 -- 10.20.193.12:0/726255605 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fc14808e320 con 0x7fc1541125c0 2026-02-13T21:18:27.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.661+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc1541210f0 con 0x7fc1541125c0 2026-02-13T21:18:27.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.663+0000 7fc1427fc640 1 -- 10.20.193.12:0/726255605 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+196714 (secure 0 0 0) 0x7fc148093420 con 0x7fc1541125c0 2026-02-13T21:18:27.670 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:27.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc1300794c0 msgr2=0x7fc1300999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc1300794c0 0x7fc1300999d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc154121690 tx=0x7fc144005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:27.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 msgr2=0x7fc15411b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 0x7fc15411b340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc148002db0 tx=0x7fc148002de0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 shutdown_connections 2026-02-13T21:18:27.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc1300794c0 0x7fc1300999d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc1541125c0 0x7fc15411b340 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 --2- 10.20.193.12:0/726255605 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc15410cc80 0x7fc15411adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 >> 10.20.193.12:0/726255605 conn(0x7fc1540ea4b0 msgr2=0x7fc1541105b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:27.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 shutdown_connections 2026-02-13T21:18:27.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.664+0000 7fc15b386640 1 -- 10.20.193.12:0/726255605 wait complete. 2026-02-13T21:18:27.705 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":19,"flags":0,"active_gid":14215,"active_name":"trial012.zqhrrq","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6800","nonce":1207525031},{"type":"v1","addr":"10.20.193.12:6801","nonce":1207525031}]},"active_addr":"10.20.193.12:6801/1207525031","active_change":"2026-02-13T21:17:01.611319+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":14236,"name":"trial090.qsdrej","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.12:8443/","prometheus":"http://10.20.193.12:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.12:0","nonce":2117961584}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.12:0","nonce":2295596053}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.12:0","nonce":1265084019}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.12:0","nonce":3148807415}]}]} 2026-02-13T21:18:27.713 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T21:18:27.713 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T21:18:27.713 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T21:18:27.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:27 trial090 ceph-mon[42877]: osdmap e46: 8 total, 8 up, 8 in 2026-02-13T21:18:27.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:27 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/540919533' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T21:18:27.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:27 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/540919533' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T21:18:27.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:27 trial090 ceph-mon[42877]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T21:18:27.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:27 trial090 ceph-mon[42877]: from='client.? 10.20.193.90:0/2670402933' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T21:18:27.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:27 trial090 ceph-mon[42877]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T21:18:27.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:27 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/385418972' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T21:18:27.832 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:27.950 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 -- 10.20.193.12:0/2611968114 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 msgr2=0x7faea0109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.950 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 --2- 10.20.193.12:0/2611968114 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 0x7faea0109ce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fae8c005fd0 tx=0x7fae8c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.950 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 -- 10.20.193.12:0/2611968114 shutdown_connections 2026-02-13T21:18:27.950 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 --2- 10.20.193.12:0/2611968114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faea010f210 0x7faea010f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.950 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 --2- 10.20.193.12:0/2611968114 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 0x7faea0109ce0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.950 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 -- 10.20.193.12:0/2611968114 >> 10.20.193.12:0/2611968114 conn(0x7faea00e7050 msgr2=0x7faea01074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:27.950 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 -- 10.20.193.12:0/2611968114 shutdown_connections 2026-02-13T21:18:27.950 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 -- 10.20.193.12:0/2611968114 wait complete. 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 Processor -- start 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.944+0000 7faea67cc640 1 -- start start 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7faea67cc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 0x7faea00e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7faea67cc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faea010f210 0x7faea00e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7faea67cc640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7faea01529f0 con 0x7faea01098d0 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7faea67cc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faea0152870 con 0x7faea010f210 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9ffff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 0x7faea00e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9ffff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 0x7faea00e7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50224/0 (socket says 10.20.193.12:50224) 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9ffff640 1 -- 10.20.193.12:0/672044968 learned_addr learned my addr 10.20.193.12:0/672044968 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9f7fe640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faea010f210 0x7faea00e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.951 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9ffff640 1 -- 10.20.193.12:0/672044968 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faea010f210 msgr2=0x7faea00e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9ffff640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faea010f210 0x7faea00e7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9ffff640 1 -- 10.20.193.12:0/672044968 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea00e8000 con 0x7faea01098d0 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9f7fe640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faea010f210 0x7faea00e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9ffff640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 0x7faea00e7580 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae8c005a20 tx=0x7fae8c002d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9d7fa640 1 -- 10.20.193.12:0/672044968 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fae8c046070 con 0x7faea01098d0 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea00e8290 con 0x7faea01098d0 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9d7fa640 1 -- 10.20.193.12:0/672044968 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fae8c0044b0 con 0x7faea01098d0 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7fae9d7fa640 1 -- 10.20.193.12:0/672044968 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fae8c0416c0 con 0x7faea01098d0 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.945+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea00f99a0 con 0x7faea01098d0 2026-02-13T21:18:27.952 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.946+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea010ab50 con 0x7faea01098d0 2026-02-13T21:18:27.953 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.947+0000 7fae9d7fa640 1 -- 10.20.193.12:0/672044968 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fae8c038a00 con 0x7faea01098d0 2026-02-13T21:18:27.954 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.947+0000 7fae9d7fa640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fae740793f0 0x7fae74099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:27.954 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.947+0000 7fae9d7fa640 1 -- 10.20.193.12:0/672044968 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fae8c03e070 con 0x7faea01098d0 2026-02-13T21:18:27.954 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.947+0000 7fae9f7fe640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fae740793f0 0x7fae74099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:27.954 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.947+0000 7fae9f7fe640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fae740793f0 0x7fae74099900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faea010c490 tx=0x7fae90005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:27.954 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:27.949+0000 7fae9d7fa640 1 -- 10.20.193.12:0/672044968 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fae8c050020 con 0x7faea01098d0 2026-02-13T21:18:28.058 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.055+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faea0109ce0 con 0x7faea01098d0 2026-02-13T21:18:28.059 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.055+0000 7fae9d7fa640 1 -- 10.20.193.12:0/672044968 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13880 (secure 0 0 0) 0x7faea0109ce0 con 0x7faea01098d0 2026-02-13T21:18:28.060 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:28.060 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":46,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","created":"2026-02-13T21:16:19.758726+0000","modified":"2026-02-13T21:18:26.275745+0000","last_up_change":"2026-02-13T21:18:24.265543+0000","last_in_change":"2026-02-13T21:18:15.652245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T21:17:45.821822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de74b69e-730a-4162-a3cc-3daa616bf84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6802","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6803","nonce":1211901108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6804","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6805","nonce":1211901108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6808","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6809","nonce":1211901108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6806","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6807","nonce":1211901108}]},"public_addr":"10.20.193.12:6803/1211901108","cluster_addr":"10.20.193.12:6805/1211901108","heartbeat_back_addr":"10.20.193.12:6809/1211901108","heartbeat_front_addr":"10.20.193.12:6807/1211901108","state":["exists","up"]},{"osd":1,"uuid":"6118d6e3-09c9-4db8-b217-1c3327e2ea30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6810","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6811","nonce":2390579753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6812","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6813","nonce":2390579753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6816","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6817","nonce":2390579753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6814","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6815","nonce":2390579753}]},"public_addr":"10.20.193.12:6811/2390579753","cluster_addr":"10.20.193.12:6813/2390579753","heartbeat_back_addr":"10.20.193.12:6817/2390579753","heartbeat_front_addr":"10.20.193.12:6815/2390579753","state":["exists","up"]},{"osd":2,"uuid":"752d80ce-ee90-4e8a-9ccb-626e1ff2ce72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6818","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6819","nonce":1263676438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6820","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6821","nonce":1263676438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6824","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6825","nonce":1263676438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6822","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6823","nonce":1263676438}]},"public_addr":"10.20.193.12:6819/1263676438","cluster_addr":"10.20.193.12:6821/1263676438","heartbeat_back_addr":"10.20.193.12:6825/1263676438","heartbeat_front_addr":"10.20.193.12:6823/1263676438","state":["exists","up"]},{"osd":3,"uuid":"2e4c26bc-c190-453c-bd22-452337fb54fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6826","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6827","nonce":1782630321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6828","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6829","nonce":1782630321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6832","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6833","nonce":1782630321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6830","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6831","nonce":1782630321}]},"public_addr":"10.20.193.12:6827/1782630321","cluster_addr":"10.20.193.12:6829/1782630321","heartbeat_back_addr":"10.20.193.12:6833/1782630321","heartbeat_front_addr":"10.20.193.12:6831/1782630321","state":["exists","up"]},{"osd":4,"uuid":"2a92779e-4460-41dc-b18a-4c646ac46091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6801","nonce":1546978354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6803","nonce":1546978354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6807","nonce":1546978354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6805","nonce":1546978354}]},"public_addr":"10.20.193.90:6801/1546978354","cluster_addr":"10.20.193.90:6803/1546978354","heartbeat_back_addr":"10.20.193.90:6807/1546978354","heartbeat_front_addr":"10.20.193.90:6805/1546978354","state":["exists","up"]},{"osd":5,"uuid":"40f7e047-3d3d-4bd2-9964-d29a3ff11482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6809","nonce":2430801346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6811","nonce":2430801346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6815","nonce":2430801346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6813","nonce":2430801346}]},"public_addr":"10.20.193.90:6809/2430801346","cluster_addr":"10.20.193.90:6811/2430801346","heartbeat_back_addr":"10.20.193.90:6815/2430801346","heartbeat_front_addr":"10.20.193.90:6813/2430801346","state":["exists","up"]},{"osd":6,"uuid":"5837ab08-fa7e-4cc5-bb99-8c046a23cb8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6817","nonce":391511610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6819","nonce":391511610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6823","nonce":391511610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6821","nonce":391511610}]},"public_addr":"10.20.193.90:6817/391511610","cluster_addr":"10.20.193.90:6819/391511610","heartbeat_back_addr":"10.20.193.90:6823/391511610","heartbeat_front_addr":"10.20.193.90:6821/391511610","state":["exists","up"]},{"osd":7,"uuid":"3a9be97d-270f-4370-bb57-9a4510f4e7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6825","nonce":1694034982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6827","nonce":1694034982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6831","nonce":1694034982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6829","nonce":1694034982}]},"public_addr":"10.20.193.90:6825/1694034982","cluster_addr":"10.20.193.90:6827/1694034982","heartbeat_back_addr":"10.20.193.90:6831/1694034982","heartbeat_front_addr":"10.20.193.90:6829/1694034982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:28.184825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:35.247079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:42.366420+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:49.338130+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:57.851801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:06.994774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:13.782179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:22.858730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.12:0/1300378024":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/3296163882":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6801/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/172285562":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6800/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3542302382":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/72325951":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3948096534":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3481816594":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2322493062":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2357723980":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6800/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/3800148741":"2026-02-14T21:17:01.611190+0000","10.20.193.12:6800/3481816594":"2026-02-14T21:17:01.611190+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T21:18:28.061 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fae740793f0 msgr2=0x7fae74099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.061 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fae740793f0 0x7fae74099900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faea010c490 tx=0x7fae90005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:28.061 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 msgr2=0x7faea00e7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.061 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 0x7faea00e7580 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae8c005a20 tx=0x7fae8c002d90 comp rx=0 tx=0).stop 2026-02-13T21:18:28.061 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 shutdown_connections 2026-02-13T21:18:28.062 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fae740793f0 0x7fae74099900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.062 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faea010f210 0x7faea00e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.062 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 --2- 10.20.193.12:0/672044968 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faea01098d0 0x7faea00e7580 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.062 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 >> 10.20.193.12:0/672044968 conn(0x7faea00e7050 msgr2=0x7faea0054710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.062 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 shutdown_connections 2026-02-13T21:18:28.062 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.056+0000 7faea67cc640 1 -- 10.20.193.12:0/672044968 wait complete. 2026-02-13T21:18:28.099 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T21:18:28.099 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T21:18:28.217 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.332 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.329+0000 7f41beb4f640 1 -- 10.20.193.12:0/1983969560 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 msgr2=0x7f41b810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.333 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.329+0000 7f41beb4f640 1 --2- 10.20.193.12:0/1983969560 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 0x7f41b810bcb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f41a8005fd0 tx=0x7f41a802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.333 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.329+0000 7f41beb4f640 1 -- 10.20.193.12:0/1983969560 shutdown_connections 2026-02-13T21:18:28.333 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.329+0000 7f41beb4f640 1 --2- 10.20.193.12:0/1983969560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41b810c1f0 0x7f41b8150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.333 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.329+0000 7f41beb4f640 1 --2- 10.20.193.12:0/1983969560 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 0x7f41b810bcb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.333 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.329+0000 7f41beb4f640 1 -- 10.20.193.12:0/1983969560 >> 10.20.193.12:0/1983969560 conn(0x7f41b80e7050 msgr2=0x7f41b81074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.333 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.329+0000 7f41beb4f640 1 -- 10.20.193.12:0/1983969560 shutdown_connections 2026-02-13T21:18:28.333 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.329+0000 7f41beb4f640 1 -- 10.20.193.12:0/1983969560 wait complete. 2026-02-13T21:18:28.334 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41beb4f640 1 Processor -- start 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41beb4f640 1 -- start start 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41beb4f640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 0x7f41b80f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41beb4f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41b810c1f0 0x7f41b80f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41beb4f640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41b8153b30 con 0x7f41b810b8a0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41beb4f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41b81539b0 con 0x7f41b810c1f0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41bc8c4640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 0x7f41b80f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41bc8c4640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 0x7f41b80f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50232/0 (socket says 10.20.193.12:50232) 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41bc8c4640 1 -- 10.20.193.12:0/638403428 learned_addr learned my addr 10.20.193.12:0/638403428 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41affff640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41b810c1f0 0x7f41b80f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41bc8c4640 1 -- 10.20.193.12:0/638403428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41b810c1f0 msgr2=0x7f41b80f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41bc8c4640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41b810c1f0 0x7f41b80f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41bc8c4640 1 -- 10.20.193.12:0/638403428 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b80fa1d0 con 0x7f41b810b8a0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41bc8c4640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 0x7f41b80f4990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41a8005a20 tx=0x7f41a8002db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41adffb640 1 -- 10.20.193.12:0/638403428 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f41a8046070 con 0x7f41b810b8a0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41adffb640 1 -- 10.20.193.12:0/638403428 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f41a8004420 con 0x7f41b810b8a0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b80fa460 con 0x7f41b810b8a0 2026-02-13T21:18:28.335 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41adffb640 1 -- 10.20.193.12:0/638403428 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f41a8041630 con 0x7f41b810b8a0 2026-02-13T21:18:28.336 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.330+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b80faa10 con 0x7f41b810b8a0 2026-02-13T21:18:28.336 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.331+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b8054b30 con 0x7f41b810b8a0 2026-02-13T21:18:28.336 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.332+0000 7f41adffb640 1 -- 10.20.193.12:0/638403428 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f41a8038470 con 0x7f41b810b8a0 2026-02-13T21:18:28.336 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.332+0000 7f41adffb640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f41940793f0 0x7f4194099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.336 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.332+0000 7f41adffb640 1 -- 10.20.193.12:0/638403428 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f41a803e070 con 0x7f41b810b8a0 2026-02-13T21:18:28.336 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.332+0000 7f41affff640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f41940793f0 0x7f4194099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.336 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.333+0000 7f41affff640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f41940793f0 0x7f4194099900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41b80ea160 tx=0x7f41a0009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.339 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.335+0000 7f41adffb640 1 -- 10.20.193.12:0/638403428 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f41a808e370 con 0x7f41b810b8a0 2026-02-13T21:18:28.375 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:28 trial012 ceph-mon[37926]: pgmap v77: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:28.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:28 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/726255605' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T21:18:28.376 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:28 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/672044968' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:28.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.442+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41b80fad50 con 0x7f41b810b8a0 2026-02-13T21:18:28.447 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.443+0000 7f41adffb640 1 -- 10.20.193.12:0/638403428 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13880 (secure 0 0 0) 0x7f41a8093470 con 0x7f41b810b8a0 2026-02-13T21:18:28.447 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:28.447 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":46,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","created":"2026-02-13T21:16:19.758726+0000","modified":"2026-02-13T21:18:26.275745+0000","last_up_change":"2026-02-13T21:18:24.265543+0000","last_in_change":"2026-02-13T21:18:15.652245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T21:17:45.821822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de74b69e-730a-4162-a3cc-3daa616bf84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6802","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6803","nonce":1211901108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6804","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6805","nonce":1211901108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6808","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6809","nonce":1211901108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6806","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6807","nonce":1211901108}]},"public_addr":"10.20.193.12:6803/1211901108","cluster_addr":"10.20.193.12:6805/1211901108","heartbeat_back_addr":"10.20.193.12:6809/1211901108","heartbeat_front_addr":"10.20.193.12:6807/1211901108","state":["exists","up"]},{"osd":1,"uuid":"6118d6e3-09c9-4db8-b217-1c3327e2ea30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6810","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6811","nonce":2390579753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6812","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6813","nonce":2390579753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6816","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6817","nonce":2390579753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6814","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6815","nonce":2390579753}]},"public_addr":"10.20.193.12:6811/2390579753","cluster_addr":"10.20.193.12:6813/2390579753","heartbeat_back_addr":"10.20.193.12:6817/2390579753","heartbeat_front_addr":"10.20.193.12:6815/2390579753","state":["exists","up"]},{"osd":2,"uuid":"752d80ce-ee90-4e8a-9ccb-626e1ff2ce72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6818","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6819","nonce":1263676438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6820","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6821","nonce":1263676438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6824","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6825","nonce":1263676438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6822","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6823","nonce":1263676438}]},"public_addr":"10.20.193.12:6819/1263676438","cluster_addr":"10.20.193.12:6821/1263676438","heartbeat_back_addr":"10.20.193.12:6825/1263676438","heartbeat_front_addr":"10.20.193.12:6823/1263676438","state":["exists","up"]},{"osd":3,"uuid":"2e4c26bc-c190-453c-bd22-452337fb54fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6826","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6827","nonce":1782630321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6828","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6829","nonce":1782630321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6832","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6833","nonce":1782630321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6830","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6831","nonce":1782630321}]},"public_addr":"10.20.193.12:6827/1782630321","cluster_addr":"10.20.193.12:6829/1782630321","heartbeat_back_addr":"10.20.193.12:6833/1782630321","heartbeat_front_addr":"10.20.193.12:6831/1782630321","state":["exists","up"]},{"osd":4,"uuid":"2a92779e-4460-41dc-b18a-4c646ac46091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6801","nonce":1546978354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6803","nonce":1546978354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6807","nonce":1546978354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6805","nonce":1546978354}]},"public_addr":"10.20.193.90:6801/1546978354","cluster_addr":"10.20.193.90:6803/1546978354","heartbeat_back_addr":"10.20.193.90:6807/1546978354","heartbeat_front_addr":"10.20.193.90:6805/1546978354","state":["exists","up"]},{"osd":5,"uuid":"40f7e047-3d3d-4bd2-9964-d29a3ff11482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6809","nonce":2430801346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6811","nonce":2430801346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6815","nonce":2430801346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6813","nonce":2430801346}]},"public_addr":"10.20.193.90:6809/2430801346","cluster_addr":"10.20.193.90:6811/2430801346","heartbeat_back_addr":"10.20.193.90:6815/2430801346","heartbeat_front_addr":"10.20.193.90:6813/2430801346","state":["exists","up"]},{"osd":6,"uuid":"5837ab08-fa7e-4cc5-bb99-8c046a23cb8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6817","nonce":391511610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6819","nonce":391511610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6823","nonce":391511610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6821","nonce":391511610}]},"public_addr":"10.20.193.90:6817/391511610","cluster_addr":"10.20.193.90:6819/391511610","heartbeat_back_addr":"10.20.193.90:6823/391511610","heartbeat_front_addr":"10.20.193.90:6821/391511610","state":["exists","up"]},{"osd":7,"uuid":"3a9be97d-270f-4370-bb57-9a4510f4e7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6825","nonce":1694034982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6827","nonce":1694034982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6831","nonce":1694034982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6829","nonce":1694034982}]},"public_addr":"10.20.193.90:6825/1694034982","cluster_addr":"10.20.193.90:6827/1694034982","heartbeat_back_addr":"10.20.193.90:6831/1694034982","heartbeat_front_addr":"10.20.193.90:6829/1694034982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:28.184825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:35.247079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:42.366420+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:49.338130+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:57.851801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:06.994774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:13.782179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:22.858730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.12:0/1300378024":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/3296163882":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6801/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/172285562":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6800/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3542302382":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/72325951":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3948096534":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3481816594":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2322493062":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2357723980":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6800/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/3800148741":"2026-02-14T21:17:01.611190+0000","10.20.193.12:6800/3481816594":"2026-02-14T21:17:01.611190+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T21:18:28.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f41940793f0 msgr2=0x7f4194099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f41940793f0 0x7f4194099900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41b80ea160 tx=0x7f41a0009260 comp rx=0 tx=0).stop 2026-02-13T21:18:28.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 msgr2=0x7f41b80f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.449 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 0x7f41b80f4990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41a8005a20 tx=0x7f41a8002db0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.449 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 shutdown_connections 2026-02-13T21:18:28.449 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f41940793f0 0x7f4194099900 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.449 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41b810c1f0 0x7f41b80f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.449 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 --2- 10.20.193.12:0/638403428 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f41b810b8a0 0x7f41b80f4990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.449 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 >> 10.20.193.12:0/638403428 conn(0x7f41b80e7050 msgr2=0x7f41b80eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.449 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 shutdown_connections 2026-02-13T21:18:28.449 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.444+0000 7f41beb4f640 1 -- 10.20.193.12:0/638403428 wait complete. 2026-02-13T21:18:28.486 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T21:18:28.487 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T21:18:28.487 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T21:18:28.488 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T21:18:28.488 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T21:18:28.489 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T21:18:28.489 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T21:18:28.489 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T21:18:28.616 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.617 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.618 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.619 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.619 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.621 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.635 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.645 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f66aa2c5640 1 -- 10.20.193.12:0/2231568340 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 msgr2=0x7f66a410bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/2231568340 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 0x7f66a410bd10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6690009840 tx=0x7f669002f160 comp rx=0 tx=0).stop 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f66aa2c5640 1 -- 10.20.193.12:0/2231568340 shutdown_connections 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/2231568340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66a410c250 0x7f66a41507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/2231568340 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 0x7f66a410bd10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f66aa2c5640 1 -- 10.20.193.12:0/2231568340 >> 10.20.193.12:0/2231568340 conn(0x7f66a40e70b0 msgr2=0x7f66a4107500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f66aa2c5640 1 -- 10.20.193.12:0/2231568340 shutdown_connections 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f66aa2c5640 1 -- 10.20.193.12:0/2231568340 wait complete. 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.760+0000 7f389d4fb640 1 -- 10.20.193.12:0/3532098811 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f388c002d40 con 0x7f389810c240 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 -- 10.20.193.12:0/3532098811 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 msgr2=0x7f3898150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.764 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 --2- 10.20.193.12:0/3532098811 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 0x7f3898150790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f388c005fd0 tx=0x7f388c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 -- 10.20.193.12:0/2210703739 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 msgr2=0x7f1a10055030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 --2- 10.20.193.12:0/2210703739 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 0x7f1a10055030 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009840 tx=0x7f19fc02f160 comp rx=0 tx=0).stop 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 -- 10.20.193.12:0/2210703739 shutdown_connections 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 --2- 10.20.193.12:0/2210703739 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a101103b0 0x7f1a101107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 --2- 10.20.193.12:0/2210703739 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 0x7f1a10055030 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 -- 10.20.193.12:0/2210703739 >> 10.20.193.12:0/2210703739 conn(0x7f1a100e70b0 msgr2=0x7f1a10107500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 -- 10.20.193.12:0/2210703739 shutdown_connections 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 -- 10.20.193.12:0/2210703739 wait complete. 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 -- 10.20.193.12:0/3532098811 shutdown_connections 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 --2- 10.20.193.12:0/3532098811 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 0x7f3898150790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 --2- 10.20.193.12:0/3532098811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f389810b8f0 0x7f389810bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 -- 10.20.193.12:0/3532098811 >> 10.20.193.12:0/3532098811 conn(0x7f38980e7080 msgr2=0x7f38981074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 -- 10.20.193.12:0/3532098811 shutdown_connections 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 -- 10.20.193.12:0/3532098811 wait complete. 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66aa2c5640 1 Processor -- start 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66aa2c5640 1 -- start start 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66aa2c5640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 0x7f66a40f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.765 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66aa2c5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66a410c250 0x7f66a40f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66aa2c5640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f66a4153b90 con 0x7f66a410b900 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66aa2c5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66a4153a10 con 0x7f66a410c250 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 Processor -- start 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 Processor -- start 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66a3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 0x7f66a40f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66a3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 0x7f66a40f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50248/0 (socket says 10.20.193.12:50248) 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66a3fff640 1 -- 10.20.193.12:0/4013410080 learned_addr learned my addr 10.20.193.12:0/4013410080 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66a37fe640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66a410c250 0x7f66a40f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f38a0788640 1 -- start start 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f1a15b85640 1 -- start start 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66a3fff640 1 -- 10.20.193.12:0/4013410080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66a410c250 msgr2=0x7f66a40f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.761+0000 7f66a3fff640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66a410c250 0x7f66a40f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f66a3fff640 1 -- 10.20.193.12:0/4013410080 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a40fcdd0 con 0x7f66a410b900 2026-02-13T21:18:28.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f38a0788640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f389810b8f0 0x7f38980f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f38a0788640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 0x7f38980f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f38a0788640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3898153b40 con 0x7f389810c240 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f38a0788640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38981539c0 con 0x7f389810b8f0 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f66a3fff640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 0x7f66a40f7590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6690032040 tx=0x7f6690004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f389dcfc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 0x7f38980f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f389dcfc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 0x7f38980f7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50254/0 (socket says 10.20.193.12:50254) 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f389dcfc640 1 -- 10.20.193.12:0/2288157142 learned_addr learned my addr 10.20.193.12:0/2288157142 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6690046070 con 0x7f66a410b900 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a40fd060 con 0x7f66a410b900 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f389e4fd640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f389810b8f0 0x7f38980f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a40fd560 con 0x7f66a410b900 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f6690002aa0 con 0x7f66a410b900 2026-02-13T21:18:28.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f66900416c0 con 0x7f66a410b900 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f389dcfc640 1 -- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f389810b8f0 msgr2=0x7f38980f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f389dcfc640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f389810b8f0 0x7f38980f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f389dcfc640 1 -- 10.20.193.12:0/2288157142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38980fcd00 con 0x7f389810c240 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f389dcfc640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 0x7f38980f7a40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f388c002db0 tx=0x7f388c002de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66a40fda90 con 0x7f66a410b900 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f388c046070 con 0x7f389810c240 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f388c004570 con 0x7f389810c240 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38980fcf90 con 0x7f389810c240 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f388c041750 con 0x7f389810c240 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38980fd540 con 0x7f389810c240 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f1a15b85640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 0x7f1a10119560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f1a15b85640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a101103b0 0x7f1a10119ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f1a15b85640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a10153b90 con 0x7f1a10054c20 2026-02-13T21:18:28.768 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f1a15b85640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a10153a10 con 0x7f1a101103b0 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f1a0f7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 0x7f1a10119560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f1a0f7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 0x7f1a10119560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50260/0 (socket says 10.20.193.12:50260) 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f1a0f7fe640 1 -- 10.20.193.12:0/1493837711 learned_addr learned my addr 10.20.193.12:0/1493837711 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.762+0000 7f1a0effd640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a101103b0 0x7f1a10119ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a0f7fe640 1 -- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a101103b0 msgr2=0x7f1a10119ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a0f7fe640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a101103b0 0x7f1a10119ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a0f7fe640 1 -- 10.20.193.12:0/1493837711 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1011ed50 con 0x7f1a10054c20 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38980fdb30 con 0x7f389810c240 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a0f7fe640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 0x7f1a10119560 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f19fc032040 tx=0x7f19fc004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f19fc046070 con 0x7f1a10054c20 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1011efe0 con 0x7f1a10054c20 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f19fc002aa0 con 0x7f1a10054c20 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f19fc041630 con 0x7f1a10054c20 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.763+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1011f510 con 0x7f1a10054c20 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a1011fb90 con 0x7f1a10054c20 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 -- 10.20.193.12:0/2503208029 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 msgr2=0x7f030410f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 --2- 10.20.193.12:0/2503208029 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 0x7f030410f680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005fd0 tx=0x7f02f802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 -- 10.20.193.12:0/2503208029 shutdown_connections 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 --2- 10.20.193.12:0/2503208029 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 0x7f030410f680 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 --2- 10.20.193.12:0/2503208029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0304109930 0x7f0304109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 -- 10.20.193.12:0/2503208029 >> 10.20.193.12:0/2503208029 conn(0x7f03040e70b0 msgr2=0x7f0304107500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.769 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 -- 10.20.193.12:0/2503208029 shutdown_connections 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f6690038a00 con 0x7f66a410b900 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 -- 10.20.193.12:0/2503208029 wait complete. 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f388c038ab0 con 0x7f389810c240 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f66a17fa640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f66780794c0 0x7f66780999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f66a37fe640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f66780794c0 0x7f66780999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f669003e070 con 0x7f66a410b900 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f387f7fe640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38740793f0 0x7f3874099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f66a17fa640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] conn(0x7f667809d8f0 0x7f66780bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 --> [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6690036e80 con 0x7f667809d8f0 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f19fc038470 con 0x7f1a10054c20 2026-02-13T21:18:28.770 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f389e4fd640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38740793f0 0x7f3874099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f030c766640 1 Processor -- start 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f66900c18d0 con 0x7f66a410b900 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f66a883b640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] conn(0x7f667809d8f0 0x7f66780bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.764+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f388c03e070 con 0x7f389810c240 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f387f7fe640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] conn(0x7f387409d820 0x7f38740bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f030c766640 1 -- start start 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 --> [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f388c00b0b0 con 0x7f387409d820 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f388c0c1950 con 0x7f389810c240 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f66a37fe640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f66780794c0 0x7f66780999d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f66a40532d0 tx=0x7f6694009310 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f389e4fd640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38740793f0 0x7f3874099900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f38980fdd90 tx=0x7f3888005dc0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.771 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f66a883b640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] conn(0x7f667809d8f0 0x7f66780bdd40 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f030c766640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0304109930 0x7f03040f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f030c766640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 0x7f03040f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f030c766640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0304152a10 con 0x7f030410f270 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f030c766640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0304152890 con 0x7f0304109930 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f1a0cff9640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19e40793f0 0x7f19e4099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f389ecfe640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] conn(0x7f387409d820 0x7f38740bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f0309cda640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 0x7f03040f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f0309cda640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 0x7f03040f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50286/0 (socket says 10.20.193.12:50286) 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f0309cda640 1 -- 10.20.193.12:0/3688702290 learned_addr learned my addr 10.20.193.12:0/3688702290 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f1a0effd640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19e40793f0 0x7f19e4099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f19fc03e070 con 0x7f1a10054c20 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f030a4db640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0304109930 0x7f03040f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f1a0cff9640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] conn(0x7f19e409d820 0x7f19e40bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.772 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 --> [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19fc04be50 con 0x7f19e409d820 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f0309cda640 1 -- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0304109930 msgr2=0x7f03040f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f0309cda640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0304109930 0x7f03040f1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f19fc0c1730 con 0x7f1a10054c20 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f0309cda640 1 -- 10.20.193.12:0/3688702290 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03040f7790 con 0x7f030410f270 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f1a0effd640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19e40793f0 0x7f19e4099900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a1010e3b0 tx=0x7f1a00009310 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f0309cda640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 0x7f03040f2490 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f02f8002c70 tx=0x7f02f8002ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f1a0ffff640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] conn(0x7f19e409d820 0x7f19e40bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f02f8046070 con 0x7f030410f270 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03040f7a20 con 0x7f030410f270 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f02f8004420 con 0x7f030410f270 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f02f8041630 con 0x7f030410f270 2026-02-13T21:18:28.773 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 <== osd.3 v2:10.20.193.12:6826/1782630321 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7f6690036e80 con 0x7f667809d8f0 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f389ecfe640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] conn(0x7f387409d820 0x7f38740bdc70 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.765+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03040f7f50 con 0x7f030410f270 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.766+0000 7f1a0ffff640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] conn(0x7f19e409d820 0x7f19e40bdc70 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.766+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 <== osd.4 v2:10.20.193.90:6800/1546978354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7f388c00b0b0 con 0x7f387409d820 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.766+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03040f8480 con 0x7f030410f270 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.766+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 <== osd.5 v2:10.20.193.90:6808/2430801346 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7f19fc04be50 con 0x7f19e409d820 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f02f8038470 con 0x7f030410f270 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7fdda916b640 1 -- 10.20.193.12:0/4263013264 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 msgr2=0x7fdda4109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7fdda916b640 1 --2- 10.20.193.12:0/4263013264 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 0x7fdda4109d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005fd0 tx=0x7fdd9802f1f0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.774 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7fdda916b640 1 -- 10.20.193.12:0/4263013264 shutdown_connections 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7fdda916b640 1 --2- 10.20.193.12:0/4263013264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdda410f270 0x7fdda410f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7fdda916b640 1 --2- 10.20.193.12:0/4263013264 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 0x7fdda4109d40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7fdda916b640 1 -- 10.20.193.12:0/4263013264 >> 10.20.193.12:0/4263013264 conn(0x7fdda40e70b0 msgr2=0x7fdda4107500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7fdda916b640 1 -- 10.20.193.12:0/4263013264 shutdown_connections 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7fdda916b640 1 -- 10.20.193.12:0/4263013264 wait complete. 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f939876a640 1 -- 10.20.193.12:0/1371633768 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 msgr2=0x7f9390109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f939876a640 1 --2- 10.20.193.12:0/1371633768 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 0x7f9390109d30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9380005fd0 tx=0x7f938002f1f0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f02eb7fe640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f02e00793f0 0x7f02e0099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 -- 10.20.193.12:0/1402957776 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 msgr2=0x7f973c10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 --2- 10.20.193.12:0/1402957776 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 0x7f973c10bb20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9728005fd0 tx=0x7f972802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 -- 10.20.193.12:0/1402957776 shutdown_connections 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 --2- 10.20.193.12:0/1402957776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f973c10c140 0x7f973c150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 --2- 10.20.193.12:0/1402957776 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 0x7f973c10bb20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 -- 10.20.193.12:0/1402957776 >> 10.20.193.12:0/1402957776 conn(0x7f973c0e7010 msgr2=0x7f973c107460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 -- 10.20.193.12:0/1402957776 shutdown_connections 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 -- 10.20.193.12:0/1402957776 wait complete. 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 Processor -- start 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.767+0000 7f9741f4f640 1 -- start start 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f030a4db640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f02e00793f0 0x7f02e0099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.775 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f02f803e070 con 0x7f030410f270 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9741f4f640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 0x7f973c0f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f02eb7fe640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] conn(0x7f02e009d820 0x7f02e00bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 --> [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02f8048e50 con 0x7f02e009d820 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f02f80c52a0 con 0x7f030410f270 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9741f4f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f973c10c140 0x7f973c0f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9741f4f640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f973c153ac0 con 0x7f973c10b710 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9741f4f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f973c153940 con 0x7f973c10c140 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973b7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 0x7f973c0f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973b7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 0x7f973c0f47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50322/0 (socket says 10.20.193.12:50322) 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973b7fe640 1 -- 10.20.193.12:0/3875035543 learned_addr learned my addr 10.20.193.12:0/3875035543 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f030a4db640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f02e00793f0 0x7f02e0099900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03040f8820 tx=0x7f02f4009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.776 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda916b640 1 Processor -- start 2026-02-13T21:18:28.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:28 trial090 ceph-mon[42877]: pgmap v77: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:28.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:28 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/726255605' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T21:18:28.777 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:28 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/672044968' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:28.777 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f030acdc640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] conn(0x7f02e009d820 0x7f02e00bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.777 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973affd640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f973c10c140 0x7f973c0f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.777 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973b7fe640 1 -- 10.20.193.12:0/3875035543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f973c10c140 msgr2=0x7f973c0f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.777 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda916b640 1 -- start start 2026-02-13T21:18:28.777 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973b7fe640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f973c10c140 0x7f973c0f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.777 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973b7fe640 1 -- 10.20.193.12:0/3875035543 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c0fa020 con 0x7f973c10b710 2026-02-13T21:18:28.777 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973affd640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f973c10c140 0x7f973c0f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:28.777 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f973b7fe640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 0x7f973c0f47e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9728005a20 tx=0x7f9728002db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9728046070 con 0x7f973c10b710 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c0fa2b0 con 0x7f973c10b710 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f9728004420 con 0x7f973c10b710 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9728041630 con 0x7f973c10b710 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda916b640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 0x7fdda41183e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda916b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdda410f270 0x7fdda4118960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f030acdc640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] conn(0x7f02e009d820 0x7f02e00bdc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda916b640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdda4152ab0 con 0x7fdda4109930 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda916b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdda4152930 con 0x7fdda410f270 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c0fa860 con 0x7f973c10b710 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda2d76640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 0x7fdda41183e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda2d76640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 0x7fdda41183e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50334/0 (socket says 10.20.193.12:50334) 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda2d76640 1 -- 10.20.193.12:0/1191341686 learned_addr learned my addr 10.20.193.12:0/1191341686 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.778 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.768+0000 7fdda2575640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdda410f270 0x7fdda4118960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f973c0fae50 con 0x7f973c10b710 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7fdda2575640 1 -- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 msgr2=0x7fdda41183e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 <== osd.7 v2:10.20.193.90:6824/1694034982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7f02f8048e50 con 0x7f02e009d820 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f939876a640 1 -- 10.20.193.12:0/1371633768 shutdown_connections 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f939876a640 1 --2- 10.20.193.12:0/1371633768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f939010f260 0x7f939010f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f939876a640 1 --2- 10.20.193.12:0/1371633768 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 0x7f9390109d30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f939876a640 1 -- 10.20.193.12:0/1371633768 >> 10.20.193.12:0/1371633768 conn(0x7f93900e7080 msgr2=0x7f93901074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f939876a640 1 -- 10.20.193.12:0/1371633768 shutdown_connections 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7fdda2575640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 0x7fdda41183e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7fdda2575640 1 -- 10.20.193.12:0/1191341686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda411dc20 con 0x7fdda410f270 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7fdda2d76640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 0x7fdda41183e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7fdda2575640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdda410f270 0x7fdda4118960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdda4053480 tx=0x7fdd8c00b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.779 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f939876a640 1 -- 10.20.193.12:0/1371633768 wait complete. 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f939876a640 1 Processor -- start 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fdd8c016070 con 0x7fdda410f270 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fdd8c004440 con 0x7fdda410f270 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fdd8c0119f0 con 0x7fdda410f270 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.769+0000 7f939876a640 1 -- start start 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f9728038470 con 0x7f973c10b710 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f939876a640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 0x7f93900ee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f939876a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f939010f260 0x7f93900eef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f939876a640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9390152aa0 con 0x7f9390109920 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f939876a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9390152920 con 0x7f939010f260 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93964df640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 0x7f93900ee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93964df640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 0x7f93900ee9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50342/0 (socket says 10.20.193.12:50342) 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93964df640 1 -- 10.20.193.12:0/4158412012 learned_addr learned my addr 10.20.193.12:0/4158412012 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.780 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda411df10 con 0x7fdda410f270 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda411e4f0 con 0x7fdda410f270 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f9738ff9640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f97100794c0 0x7f97100999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f972803e070 con 0x7f973c10b710 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f973affd640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f97100794c0 0x7f97100999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f9395cde640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f939010f260 0x7f93900eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f9738ff9640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] conn(0x7f971009d8f0 0x7f97100bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93964df640 1 -- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f939010f260 msgr2=0x7f93900eef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93964df640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f939010f260 0x7f93900eef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 --> [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9728035e70 con 0x7f971009d8f0 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f97280c15c0 con 0x7f973c10b710 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93964df640 1 -- 10.20.193.12:0/4158412012 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93900ef600 con 0x7f9390109920 2026-02-13T21:18:28.781 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f973bfff640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] conn(0x7f971009d8f0 0x7f97100bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f973affd640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f97100794c0 0x7f97100999d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f973c0e8d10 tx=0x7f972c009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdda410abb0 con 0x7fdda410f270 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93964df640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 0x7f93900ee9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9380005fa0 tx=0x7f9380002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9380046070 con 0x7f9390109920 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f93800054e0 con 0x7f9390109920 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f973bfff640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] conn(0x7f971009d8f0 0x7f97100bdd40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9380004df0 con 0x7f9390109920 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f939876a640 1 -- 10.20.193.12:0/4158412012 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93900f42c0 con 0x7f9390109920 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.770+0000 7f939876a640 1 -- 10.20.193.12:0/4158412012 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93900f4840 con 0x7f9390109920 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.771+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f935c001030 con 0x7f9390109920 2026-02-13T21:18:28.782 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.771+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 <== osd.0 v2:10.20.193.12:6802/1211901108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7f9728035e70 con 0x7f971009d8f0 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.771+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fdd8c0026d0 con 0x7fdda410f270 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fdd83fff640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdd780794c0 0x7fdd780999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 -- 10.20.193.12:0/3286359476 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 msgr2=0x7fa41810ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3286359476 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 0x7fa41810ae10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa408005fd0 tx=0x7fa40802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 -- 10.20.193.12:0/3286359476 shutdown_connections 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3286359476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa418110340 0x7fa418110750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3286359476 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 0x7fa41810ae10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 -- 10.20.193.12:0/3286359476 >> 10.20.193.12:0/3286359476 conn(0x7fa4180e8180 msgr2=0x7fa4181085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 -- 10.20.193.12:0/3286359476 shutdown_connections 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fdda2d76640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdd780794c0 0x7fdd780999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fdd8c09bb60 con 0x7fdda410f270 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fdd83fff640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] conn(0x7fdd7809d8f0 0x7fdd780bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 --> [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd780be410 con 0x7fdd7809d8f0 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fdd8c09bfa0 con 0x7fdda410f270 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fdda2d76640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdd780794c0 0x7fdd780999d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005b60 tx=0x7fdd9803a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.783 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f9380005050 con 0x7f9390109920 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 -- 10.20.193.12:0/3286359476 wait complete. 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 Processor -- start 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7fa41fe35640 1 -- start start 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.772+0000 7f93777fe640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f936c0794c0 0x7f936c0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41fe35640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 0x7fa4180ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41fe35640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa418110340 0x7fa4180ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41fe35640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa418153b20 con 0x7fa41810aa00 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41fe35640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4181539a0 con 0x7fa418110340 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7f9395cde640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f936c0794c0 0x7f936c0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f938003e070 con 0x7f9390109920 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7f93777fe640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] conn(0x7f936c09d8f0 0x7f936c0bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 --> [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9380042e80 con 0x7f936c09d8f0 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f93800c1860 con 0x7f9390109920 2026-02-13T21:18:28.784 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fdda3577640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] conn(0x7fdd7809d8f0 0x7fdd780bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41dbaa640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 0x7fa4180ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41dbaa640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 0x7fa4180ebd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50358/0 (socket says 10.20.193.12:50358) 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41dbaa640 1 -- 10.20.193.12:0/3102823107 learned_addr learned my addr 10.20.193.12:0/3102823107 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41dbaa640 1 -- 10.20.193.12:0/3102823107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa418110340 msgr2=0x7fa4180ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41dbaa640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa418110340 0x7fa4180ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7f9396ce0640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] conn(0x7f936c09d8f0 0x7f936c0bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41dbaa640 1 -- 10.20.193.12:0/3102823107 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4180f15d0 con 0x7fa41810aa00 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7f9395cde640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f936c0794c0 0x7f936c0999d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f939010d120 tx=0x7f9384008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41dbaa640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 0x7fa4180ebd90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa408005a20 tx=0x7fa408004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa408046070 con 0x7fa41810aa00 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fdda3577640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] conn(0x7fdd7809d8f0 0x7fdd780bdd40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fa4080045a0 con 0x7fa41810aa00 2026-02-13T21:18:28.785 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4180f1860 con 0x7fa41810aa00 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa408041750 con 0x7fa41810aa00 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4180f1d90 con 0x7fa41810aa00 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.773+0000 7f9396ce0640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] conn(0x7f936c09d8f0 0x7f936c0bdd40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.774+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 <== osd.2 v2:10.20.193.12:6818/1263676438 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fdd780be410 con 0x7fdd7809d8f0 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.774+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 <== osd.6 v2:10.20.193.90:6816/391511610 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7f9380042e80 con 0x7f936c09d8f0 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.774+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4180f2380 con 0x7fa41810aa00 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.774+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fa408038ae0 con 0x7fa41810aa00 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 --> [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f66a404c7c0 con 0x7f667809d8f0 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa406ffd640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa3f40793f0 0x7fa3f4099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fa40803e070 con 0x7fa41810aa00 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa406ffd640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] conn(0x7fa3f409d820 0x7fa3f40bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 --> [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa40803fec0 con 0x7fa3f409d820 2026-02-13T21:18:28.786 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f66a17fa640 1 -- 10.20.193.12:0/4013410080 <== osd.3 v2:10.20.193.12:6826/1782630321 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f66a404c7c0 con 0x7f667809d8f0 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fa4080c3550 con 0x7fa41810aa00 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa41d3a9640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa3f40793f0 0x7fa3f4099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa41e3ab640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] conn(0x7fa3f409d820 0x7fa3f40bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa41d3a9640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa3f40793f0 0x7fa3f4099900 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa41810d2f0 tx=0x7fa40c005cd0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] conn(0x7f667809d8f0 msgr2=0x7f66780bdd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] conn(0x7f667809d8f0 0x7f66780bdd40 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f66780794c0 msgr2=0x7f66780999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f66780794c0 0x7f66780999d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f66a40532d0 tx=0x7f6694009310 comp rx=0 tx=0).stop 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 msgr2=0x7f66a40f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 0x7f66a40f7590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6690032040 tx=0x7f6690004660 comp rx=0 tx=0).stop 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 --> [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f389804c7c0 con 0x7f387409d820 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7fa41e3ab640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] conn(0x7fa3f409d820 0x7fa3f40bdc70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:28.787 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 --> [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a1004c790 con 0x7f19e409d820 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.775+0000 7f387f7fe640 1 -- 10.20.193.12:0/2288157142 <== osd.4 v2:10.20.193.90:6800/1546978354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f389804c7c0 con 0x7f387409d820 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a0cff9640 1 -- 10.20.193.12:0/1493837711 <== osd.5 v2:10.20.193.90:6808/2430801346 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1a1004c790 con 0x7f19e409d820 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] conn(0x7f19e409d820 msgr2=0x7f19e40bdc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] conn(0x7f19e409d820 0x7f19e40bdc70 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19e40793f0 msgr2=0x7f19e4099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19e40793f0 0x7f19e4099900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a1010e3b0 tx=0x7f1a00009310 comp rx=0 tx=0).stop 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 msgr2=0x7f1a10119560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 0x7f1a10119560 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f19fc032040 tx=0x7f19fc004660 comp rx=0 tx=0).stop 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 shutdown_connections 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:6808/2430801346,v1:10.20.193.90:6809/2430801346] conn(0x7f19e409d820 0x7f19e40bdc70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f19e40793f0 0x7f19e4099900 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1a101103b0 0x7f1a10119ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 --2- 10.20.193.12:0/1493837711 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1a10054c20 0x7f1a10119560 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 >> 10.20.193.12:0/1493837711 conn(0x7f1a100e70b0 msgr2=0x7f1a101074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 shutdown_connections 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7f1a15b85640 1 -- 10.20.193.12:0/1493837711 wait complete. 2026-02-13T21:18:28.788 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.776+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 <== osd.1 v2:10.20.193.12:6810/2390579753 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fa40803fec0 con 0x7fa3f409d820 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.777+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 shutdown_connections 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.777+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6826/1782630321,v1:10.20.193.12:6827/1782630321] conn(0x7f667809d8f0 0x7f66780bdd40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.777+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f66780794c0 0x7f66780999d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.777+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66a410c250 0x7f66a40f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.777+0000 7f66aa2c5640 1 --2- 10.20.193.12:0/4013410080 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f66a410b900 0x7f66a40f7590 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.777+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 >> 10.20.193.12:0/4013410080 conn(0x7f66a40e70b0 msgr2=0x7f66a410aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.777+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 shutdown_connections 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.778+0000 7f66aa2c5640 1 -- 10.20.193.12:0/4013410080 wait complete. 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.778+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 --> [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0304108990 con 0x7f02e009d820 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f02eb7fe640 1 -- 10.20.193.12:0/3688702290 <== osd.7 v2:10.20.193.90:6824/1694034982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0304108990 con 0x7f02e009d820 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] conn(0x7f387409d820 msgr2=0x7f38740bdc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] conn(0x7f387409d820 0x7f38740bdc70 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] conn(0x7f02e009d820 msgr2=0x7f02e00bdc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] conn(0x7f02e009d820 0x7f02e00bdc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f02e00793f0 msgr2=0x7f02e0099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f02e00793f0 0x7f02e0099900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03040f8820 tx=0x7f02f4009260 comp rx=0 tx=0).stop 2026-02-13T21:18:28.789 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 msgr2=0x7f03040f2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 0x7f03040f2490 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f02f8002c70 tx=0x7f02f8002ca0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38740793f0 msgr2=0x7f3874099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38740793f0 0x7f3874099900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f38980fdd90 tx=0x7f3888005dc0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 msgr2=0x7f38980f7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 0x7f38980f7a40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f388c002db0 tx=0x7f388c002de0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 shutdown_connections 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f02e00793f0 0x7f02e0099900 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f030410f270 0x7f03040f2490 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:6824/1694034982,v1:10.20.193.90:6825/1694034982] conn(0x7f02e009d820 0x7f02e00bdc70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 shutdown_connections 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:6800/1546978354,v1:10.20.193.90:6801/1546978354] conn(0x7f387409d820 0x7f38740bdc70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f38740793f0 0x7f3874099900 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f389810c240 0x7f38980f7a40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 --2- 10.20.193.12:0/2288157142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f389810b8f0 0x7f38980f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 >> 10.20.193.12:0/2288157142 conn(0x7f38980e7080 msgr2=0x7f389810aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 shutdown_connections 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f38a0788640 1 -- 10.20.193.12:0/2288157142 wait complete. 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 --2- 10.20.193.12:0/3688702290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0304109930 0x7f03040f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.779+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 >> 10.20.193.12:0/3688702290 conn(0x7f03040e70b0 msgr2=0x7f030410dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.790 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.780+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 --> [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f973c0ef7a0 con 0x7f971009d8f0 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.780+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 shutdown_connections 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.780+0000 7f030c766640 1 -- 10.20.193.12:0/3688702290 wait complete. 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.780+0000 7f9738ff9640 1 -- 10.20.193.12:0/3875035543 <== osd.0 v2:10.20.193.12:6802/1211901108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f973c0ef7a0 con 0x7f971009d8f0 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.780+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] conn(0x7f971009d8f0 msgr2=0x7f97100bdd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.780+0000 7f9741f4f640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] conn(0x7f971009d8f0 0x7f97100bdd40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f97100794c0 msgr2=0x7f97100999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f97100794c0 0x7f97100999d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f973c0e8d10 tx=0x7f972c009260 comp rx=0 tx=0).stop 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 msgr2=0x7f973c0f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 0x7f973c0f47e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9728005a20 tx=0x7f9728002db0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 shutdown_connections 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6802/1211901108,v1:10.20.193.12:6803/1211901108] conn(0x7f971009d8f0 0x7f97100bdd40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f97100794c0 0x7f97100999d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f973c10c140 0x7f973c0f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 --2- 10.20.193.12:0/3875035543 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f973c10b710 0x7f973c0f47e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 >> 10.20.193.12:0/3875035543 conn(0x7f973c0e7010 msgr2=0x7f973c0eee10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 shutdown_connections 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.783+0000 7f9741f4f640 1 -- 10.20.193.12:0/3875035543 wait complete. 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.784+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 --> [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdda404c7c0 con 0x7fdd7809d8f0 2026-02-13T21:18:28.791 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.784+0000 7fdd83fff640 1 -- 10.20.193.12:0/1191341686 <== osd.2 v2:10.20.193.12:6818/1263676438 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdda404c7c0 con 0x7fdd7809d8f0 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.784+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 --> [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa41810eae0 con 0x7fa3f409d820 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.784+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] conn(0x7fdd7809d8f0 msgr2=0x7fdd780bdd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.784+0000 7fdda916b640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] conn(0x7fdd7809d8f0 0x7fdd780bdd40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdd780794c0 msgr2=0x7fdd780999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdd780794c0 0x7fdd780999d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005b60 tx=0x7fdd9803a040 comp rx=0 tx=0).stop 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.784+0000 7fa406ffd640 1 -- 10.20.193.12:0/3102823107 <== osd.1 v2:10.20.193.12:6810/2390579753 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa41810eae0 con 0x7fa3f409d820 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdda410f270 msgr2=0x7fdda4118960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdda410f270 0x7fdda4118960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdda4053480 tx=0x7fdd8c00b890 comp rx=0 tx=0).stop 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 shutdown_connections 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6818/1263676438,v1:10.20.193.12:6819/1263676438] conn(0x7fdd7809d8f0 0x7fdd780bdd40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fdd780794c0 0x7fdd780999d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdda410f270 0x7fdda4118960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 --2- 10.20.193.12:0/1191341686 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fdda4109930 0x7fdda41183e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 >> 10.20.193.12:0/1191341686 conn(0x7fdda40e70b0 msgr2=0x7fdda41074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 shutdown_connections 2026-02-13T21:18:28.792 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fdda916b640 1 -- 10.20.193.12:0/1191341686 wait complete. 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] conn(0x7fa3f409d820 msgr2=0x7fa3f40bdc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] conn(0x7fa3f409d820 0x7fa3f40bdc70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa3f40793f0 msgr2=0x7fa3f4099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa3f40793f0 0x7fa3f4099900 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa41810d2f0 tx=0x7fa40c005cd0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 msgr2=0x7fa4180ebd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 0x7fa4180ebd90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa408005a20 tx=0x7fa408004060 comp rx=0 tx=0).stop 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 shutdown_connections 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6810/2390579753,v1:10.20.193.12:6811/2390579753] conn(0x7fa3f409d820 0x7fa3f40bdc70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa3f40793f0 0x7fa3f4099900 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa418110340 0x7fa4180ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 --2- 10.20.193.12:0/3102823107 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa41810aa00 0x7fa4180ebd90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 >> 10.20.193.12:0/3102823107 conn(0x7fa4180e8180 msgr2=0x7fa41810e150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 shutdown_connections 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.785+0000 7fa41fe35640 1 -- 10.20.193.12:0/3102823107 wait complete. 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.788+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 --> [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f935c002de0 con 0x7f936c09d8f0 2026-02-13T21:18:28.793 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.788+0000 7f93777fe640 1 -- 10.20.193.12:0/4158412012 <== osd.6 v2:10.20.193.90:6816/391511610 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f935c002de0 con 0x7f936c09d8f0 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] conn(0x7f936c09d8f0 msgr2=0x7f936c0bdd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] conn(0x7f936c09d8f0 0x7f936c0bdd40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f936c0794c0 msgr2=0x7f936c0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f936c0794c0 0x7f936c0999d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f939010d120 tx=0x7f9384008040 comp rx=0 tx=0).stop 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 msgr2=0x7f93900ee9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 0x7f93900ee9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9380005fa0 tx=0x7f9380002900 comp rx=0 tx=0).stop 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 shutdown_connections 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:6816/391511610,v1:10.20.193.90:6817/391511610] conn(0x7f936c09d8f0 0x7f936c0bdd40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f936c0794c0 0x7f936c0999d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f939010f260 0x7f93900eef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 --2- 10.20.193.12:0/4158412012 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9390109920 0x7f93900ee9c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 >> 10.20.193.12:0/4158412012 conn(0x7f93900e7080 msgr2=0x7f93900548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 shutdown_connections 2026-02-13T21:18:28.794 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:28.789+0000 7f93757fa640 1 -- 10.20.193.12:0/4158412012 wait complete. 2026-02-13T21:18:28.837 INFO:teuthology.orchestra.run.trial012.stdout:120259084295 2026-02-13T21:18:28.838 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T21:18:28.839 INFO:teuthology.orchestra.run.trial012.stdout:141733920775 2026-02-13T21:18:28.840 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T21:18:28.840 INFO:teuthology.orchestra.run.trial012.stdout:188978561027 2026-02-13T21:18:28.840 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T21:18:28.846 INFO:teuthology.orchestra.run.trial012.stdout:103079215114 2026-02-13T21:18:28.846 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T21:18:28.849 INFO:teuthology.orchestra.run.trial012.stdout:38654705678 2026-02-13T21:18:28.850 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T21:18:28.867 INFO:teuthology.orchestra.run.trial012.stdout:77309411339 2026-02-13T21:18:28.868 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T21:18:28.870 INFO:teuthology.orchestra.run.trial012.stdout:55834574862 2026-02-13T21:18:28.871 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T21:18:28.874 INFO:teuthology.orchestra.run.trial012.stdout:167503724549 2026-02-13T21:18:28.875 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T21:18:28.966 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.970 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.971 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.973 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:28.974 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:29.001 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:29.003 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:29.006 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:29.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7fadf977f640 1 -- 10.20.193.12:0/3821618713 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4109700 msgr2=0x7fadf410c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7fadf977f640 1 --2- 10.20.193.12:0/3821618713 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4109700 0x7fadf410c060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faddc005fd0 tx=0x7faddc02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7fadf977f640 1 -- 10.20.193.12:0/3821618713 shutdown_connections 2026-02-13T21:18:29.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7fadf977f640 1 --2- 10.20.193.12:0/3821618713 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4109700 0x7fadf410c060 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7fadf977f640 1 --2- 10.20.193.12:0/3821618713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadf4108db0 0x7fadf41091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7fadf977f640 1 -- 10.20.193.12:0/3821618713 >> 10.20.193.12:0/3821618713 conn(0x7fadf4060840 msgr2=0x7fadf4060c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7fadf977f640 1 -- 10.20.193.12:0/3821618713 shutdown_connections 2026-02-13T21:18:29.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7fadf977f640 1 -- 10.20.193.12:0/3821618713 wait complete. 2026-02-13T21:18:29.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7f9fc9815640 1 -- 10.20.193.12:0/26213633 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410c1c0 msgr2=0x7f9fc4150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7f9fc9815640 1 --2- 10.20.193.12:0/26213633 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410c1c0 0x7f9fc4150800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9fac005fd0 tx=0x7f9fac02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7f9fc9815640 1 -- 10.20.193.12:0/26213633 shutdown_connections 2026-02-13T21:18:29.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7f9fc9815640 1 --2- 10.20.193.12:0/26213633 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410c1c0 0x7f9fc4150800 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7f9fc9815640 1 --2- 10.20.193.12:0/26213633 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9fc410b790 0x7f9fc410bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7f9fc9815640 1 -- 10.20.193.12:0/26213633 >> 10.20.193.12:0/26213633 conn(0x7f9fc40e70b0 msgr2=0x7f9fc4107500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7f9fc9815640 1 -- 10.20.193.12:0/26213633 shutdown_connections 2026-02-13T21:18:29.110 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.103+0000 7f9fc9815640 1 -- 10.20.193.12:0/26213633 wait complete. 2026-02-13T21:18:29.110 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc9815640 1 Processor -- start 2026-02-13T21:18:29.110 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc9815640 1 -- start start 2026-02-13T21:18:29.110 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7fadf977f640 1 Processor -- start 2026-02-13T21:18:29.111 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7fadf977f640 1 -- start start 2026-02-13T21:18:29.112 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc9815640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410b790 0x7f9fc40f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.112 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc9815640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9fc410c1c0 0x7f9fc40f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.112 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc9815640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4153b20 con 0x7f9fc410b790 2026-02-13T21:18:29.112 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc9815640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41539a0 con 0x7f9fc410c1c0 2026-02-13T21:18:29.112 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc2ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410b790 0x7f9fc40f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.112 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc2ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410b790 0x7f9fc40f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42326/0 (socket says 10.20.193.12:42326) 2026-02-13T21:18:29.112 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc2ffd640 1 -- 10.20.193.12:0/2260901142 learned_addr learned my addr 10.20.193.12:0/2260901142 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:29.112 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7f9fc27fc640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9fc410c1c0 0x7f9fc40f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.113 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7fadf977f640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4108db0 0x7fadf4120eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.113 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7fadf977f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadf4109700 0x7fadf4121430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.113 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7fadf977f640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fadf415a2c0 con 0x7fadf4108db0 2026-02-13T21:18:29.113 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.104+0000 7fadf977f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fadf415a140 con 0x7fadf4109700 2026-02-13T21:18:29.113 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc2ffd640 1 -- 10.20.193.12:0/2260901142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9fc410c1c0 msgr2=0x7f9fc40f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.114 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadf2ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4108db0 0x7fadf4120eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.114 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc2ffd640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9fc410c1c0 0x7f9fc40f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.114 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc2ffd640 1 -- 10.20.193.12:0/2260901142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc40fcd00 con 0x7f9fc410b790 2026-02-13T21:18:29.115 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadf2ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4108db0 0x7fadf4120eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42338/0 (socket says 10.20.193.12:42338) 2026-02-13T21:18:29.115 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadf2ffd640 1 -- 10.20.193.12:0/3285756408 learned_addr learned my addr 10.20.193.12:0/3285756408 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:29.115 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadf27fc640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadf4109700 0x7fadf4121430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.115 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc2ffd640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410b790 0x7f9fc40f74c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80094b0 tx=0x7f9fb800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.116 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadf2ffd640 1 -- 10.20.193.12:0/3285756408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadf4109700 msgr2=0x7fadf4121430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.116 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadf2ffd640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadf4109700 0x7fadf4121430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.116 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadf2ffd640 1 -- 10.20.193.12:0/3285756408 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf41266f0 con 0x7fadf4108db0 2026-02-13T21:18:29.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc8813640 1 -- 10.20.193.12:0/2260901142 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9fb800cac0 con 0x7f9fc410b790 2026-02-13T21:18:29.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc8813640 1 -- 10.20.193.12:0/2260901142 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f9fb8004d10 con 0x7f9fc410b790 2026-02-13T21:18:29.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc40fcff0 con 0x7f9fc410b790 2026-02-13T21:18:29.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadf2ffd640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4108db0 0x7fadf4120eb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fade80026d0 tx=0x7fade8002ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc8813640 1 -- 10.20.193.12:0/2260901142 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9fb8005720 con 0x7f9fc410b790 2026-02-13T21:18:29.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc40fd600 con 0x7f9fc410b790 2026-02-13T21:18:29.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7fadd3fff640 1 -- 10.20.193.12:0/3285756408 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fade800eb40 con 0x7fadf4108db0 2026-02-13T21:18:29.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.105+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc4054ef0 con 0x7f9fc410b790 2026-02-13T21:18:29.119 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.106+0000 7fadd3fff640 1 -- 10.20.193.12:0/3285756408 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fade800ece0 con 0x7fadf4108db0 2026-02-13T21:18:29.119 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.106+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf41269e0 con 0x7fadf4108db0 2026-02-13T21:18:29.119 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.106+0000 7fadd3fff640 1 -- 10.20.193.12:0/3285756408 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fade800f770 con 0x7fadf4108db0 2026-02-13T21:18:29.119 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.106+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf4126ff0 con 0x7fadf4108db0 2026-02-13T21:18:29.119 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.106+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf4109bf0 con 0x7fadf4108db0 2026-02-13T21:18:29.120 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.106+0000 7f9fc8813640 1 -- 10.20.193.12:0/2260901142 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f9fb80047a0 con 0x7f9fc410b790 2026-02-13T21:18:29.120 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.107+0000 7f9fc8813640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9f98079570 0x7f9f98099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.120 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.107+0000 7f9fc8813640 1 -- 10.20.193.12:0/2260901142 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f9fb809cbd0 con 0x7f9fc410b790 2026-02-13T21:18:29.120 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.107+0000 7f9fc27fc640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9f98079570 0x7f9f98099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.121 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.107+0000 7fadd3fff640 1 -- 10.20.193.12:0/3285756408 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fade8010430 con 0x7fadf4108db0 2026-02-13T21:18:29.121 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.107+0000 7fadd3fff640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fadc80793f0 0x7fadc8099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.121 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.107+0000 7fadd3fff640 1 -- 10.20.193.12:0/3285756408 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fade809cb00 con 0x7fadf4108db0 2026-02-13T21:18:29.121 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.107+0000 7fadf27fc640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fadc80793f0 0x7fadc8099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.121 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.107+0000 7f9fc27fc640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9f98079570 0x7f9f98099a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40e98a0 tx=0x7f9fac03a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.122 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7f9fc8813640 1 -- 10.20.193.12:0/2260901142 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f9fb8069cf0 con 0x7f9fc410b790 2026-02-13T21:18:29.122 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.108+0000 7fadf27fc640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fadc80793f0 0x7fadc8099900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faddc005fa0 tx=0x7faddc03a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7fe3b2d95640 1 -- 10.20.193.12:0/295965632 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10b900 msgr2=0x7fe3ac10bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7fe3b2d95640 1 --2- 10.20.193.12:0/295965632 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10b900 0x7fe3ac10bd10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe39c005fd0 tx=0x7fe39c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7fe3b2d95640 1 -- 10.20.193.12:0/295965632 shutdown_connections 2026-02-13T21:18:29.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7fe3b2d95640 1 --2- 10.20.193.12:0/295965632 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3ac10c250 0x7fe3ac1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7fe3b2d95640 1 --2- 10.20.193.12:0/295965632 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10b900 0x7fe3ac10bd10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7fe3b2d95640 1 -- 10.20.193.12:0/295965632 >> 10.20.193.12:0/295965632 conn(0x7fe3ac0e70b0 msgr2=0x7fe3ac107500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7fe3b2d95640 1 -- 10.20.193.12:0/295965632 shutdown_connections 2026-02-13T21:18:29.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.110+0000 7fe3b2d95640 1 -- 10.20.193.12:0/295965632 wait complete. 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3b2d95640 1 Processor -- start 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3b2d95640 1 -- start start 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3b2d95640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3ac10b900 0x7fe3ac107fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3b2d95640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10c250 0x7fe3ac108500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3b2d95640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac153b90 con 0x7fe3ac10c250 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3b2d95640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac153a10 con 0x7fe3ac10b900 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3a3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10c250 0x7fe3ac108500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3a3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10c250 0x7fe3ac108500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42364/0 (socket says 10.20.193.12:42364) 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3a3fff640 1 -- 10.20.193.12:0/1722097928 learned_addr learned my addr 10.20.193.12:0/1722097928 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.111+0000 7fe3b0b0a640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3ac10b900 0x7fe3ac107fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.112+0000 7fe3a3fff640 1 -- 10.20.193.12:0/1722097928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3ac10b900 msgr2=0x7fe3ac107fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.112+0000 7fe3a3fff640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3ac10b900 0x7fe3ac107fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.112+0000 7fe3a3fff640 1 -- 10.20.193.12:0/1722097928 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ac10b300 con 0x7fe3ac10c250 2026-02-13T21:18:29.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.112+0000 7fe3b0b0a640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3ac10b900 0x7fe3ac107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T21:18:29.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.112+0000 7fe3a3fff640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10c250 0x7fe3ac108500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe39400d6d0 tx=0x7fe39400dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7fe3a1ffb640 1 -- 10.20.193.12:0/1722097928 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe394014070 con 0x7fe3ac10c250 2026-02-13T21:18:29.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7fe3a1ffb640 1 -- 10.20.193.12:0/1722097928 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fe39400bcd0 con 0x7fe3ac10c250 2026-02-13T21:18:29.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ac1095c0 con 0x7fe3ac10c250 2026-02-13T21:18:29.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7fe3a1ffb640 1 -- 10.20.193.12:0/1722097928 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe394002cc0 con 0x7fe3ac10c250 2026-02-13T21:18:29.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7fadd3fff640 1 -- 10.20.193.12:0/3285756408 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fade8014030 con 0x7fadf4108db0 2026-02-13T21:18:29.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ac109bd0 con 0x7fe3ac10c250 2026-02-13T21:18:29.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe374005390 con 0x7fe3ac10c250 2026-02-13T21:18:29.128 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7f7589eff640 1 -- 10.20.193.12:0/2301001805 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7584115660 msgr2=0x7f7584115a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.128 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7f7589eff640 1 --2- 10.20.193.12:0/2301001805 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7584115660 0x7f7584115a70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7570005fd0 tx=0x7f757002f1f0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.128 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7f40649fd640 1 -- 10.20.193.12:0/2578999434 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c109920 msgr2=0x7f405c109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.128 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.114+0000 7f40649fd640 1 --2- 10.20.193.12:0/2578999434 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c109920 0x7f405c109d30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4054005fd0 tx=0x7f405402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.128 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 -- 10.20.193.12:0/2578999434 shutdown_connections 2026-02-13T21:18:29.128 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 --2- 10.20.193.12:0/2578999434 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c10f260 0x7f405c10f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.128 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 --2- 10.20.193.12:0/2578999434 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c109920 0x7f405c109d30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.129 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 -- 10.20.193.12:0/2578999434 >> 10.20.193.12:0/2578999434 conn(0x7f405c0e7080 msgr2=0x7f405c1074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.129 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 -- 10.20.193.12:0/2301001805 shutdown_connections 2026-02-13T21:18:29.129 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 -- 10.20.193.12:0/2578999434 shutdown_connections 2026-02-13T21:18:29.129 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 -- 10.20.193.12:0/2578999434 wait complete. 2026-02-13T21:18:29.130 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 --2- 10.20.193.12:0/2301001805 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f758411afa0 0x7f758411b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.130 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 --2- 10.20.193.12:0/2301001805 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7584115660 0x7f7584115a70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.130 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 -- 10.20.193.12:0/2301001805 >> 10.20.193.12:0/2301001805 conn(0x7f75840572a0 msgr2=0x7f7584113900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.130 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 -- 10.20.193.12:0/2301001805 shutdown_connections 2026-02-13T21:18:29.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 -- 10.20.193.12:0/2301001805 wait complete. 2026-02-13T21:18:29.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7fe3a1ffb640 1 -- 10.20.193.12:0/1722097928 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fe39400b840 con 0x7fe3ac10c250 2026-02-13T21:18:29.131 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 Processor -- start 2026-02-13T21:18:29.132 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 -- start start 2026-02-13T21:18:29.132 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 Processor -- start 2026-02-13T21:18:29.132 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 -- start start 2026-02-13T21:18:29.133 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c109920 0x7f405c0f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.133 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c10f260 0x7f405c0f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.133 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f405c152a40 con 0x7f405c10f260 2026-02-13T21:18:29.133 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f40649fd640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1528c0 con 0x7f405c109920 2026-02-13T21:18:29.133 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7584115660 0x7f7584123830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.134 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f758411afa0 0x7f7584123db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.134 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f4061f71640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c10f260 0x7f405c0f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.134 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f4061f71640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c10f260 0x7f405c0f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42384/0 (socket says 10.20.193.12:42384) 2026-02-13T21:18:29.134 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f758415e7e0 con 0x7f758411afa0 2026-02-13T21:18:29.135 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f4061f71640 1 -- 10.20.193.12:0/2102689457 learned_addr learned my addr 10.20.193.12:0/2102689457 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:29.135 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7f7589eff640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f758415e660 con 0x7f7584115660 2026-02-13T21:18:29.136 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7fe3a1ffb640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe3880794c0 0x7fe3880999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.136 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.115+0000 7fe3a1ffb640 1 -- 10.20.193.12:0/1722097928 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fe39409c680 con 0x7fe3ac10c250 2026-02-13T21:18:29.136 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f4062772640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c109920 0x7f405c0f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.137 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f7582ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f758411afa0 0x7f7584123db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.137 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f7582ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f758411afa0 0x7f7584123db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42398/0 (socket says 10.20.193.12:42398) 2026-02-13T21:18:29.137 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f7582ffd640 1 -- 10.20.193.12:0/3660914347 learned_addr learned my addr 10.20.193.12:0/3660914347 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:29.137 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f75837fe640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7584115660 0x7f7584123830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.137 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7fe3b0b0a640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe3880794c0 0x7fe3880999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.138 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f4062772640 1 -- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c10f260 msgr2=0x7f405c0f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.138 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f4062772640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c10f260 0x7f405c0f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.138 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f4062772640 1 -- 10.20.193.12:0/2102689457 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c0f7640 con 0x7f405c109920 2026-02-13T21:18:29.138 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f4061f71640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c10f260 0x7f405c0f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T21:18:29.139 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f75837fe640 1 -- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f758411afa0 msgr2=0x7f7584123db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.139 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f75837fe640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f758411afa0 0x7f7584123db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.139 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f75837fe640 1 -- 10.20.193.12:0/3660914347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7584129070 con 0x7f7584115660 2026-02-13T21:18:29.139 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f7582ffd640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f758411afa0 0x7f7584123db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T21:18:29.139 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f4062772640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c109920 0x7f405c0f1e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4054005fd0 tx=0x7f4054002c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.140 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7fe3b0b0a640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe3880794c0 0x7fe3880999d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe39c005b60 tx=0x7fe39c03a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.140 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f40477fe640 1 -- 10.20.193.12:0/2102689457 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4054046070 con 0x7f405c109920 2026-02-13T21:18:29.140 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c0f78d0 con 0x7f405c109920 2026-02-13T21:18:29.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f75837fe640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7584115660 0x7f7584123830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7570005fa0 tx=0x7f7570004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f40477fe640 1 -- 10.20.193.12:0/2102689457 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f4054004420 con 0x7f405c109920 2026-02-13T21:18:29.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f40477fe640 1 -- 10.20.193.12:0/2102689457 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f40540415d0 con 0x7f405c109920 2026-02-13T21:18:29.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c0f7e00 con 0x7f405c109920 2026-02-13T21:18:29.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f7580ff9640 1 -- 10.20.193.12:0/3660914347 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7570046070 con 0x7f7584115660 2026-02-13T21:18:29.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f7580ff9640 1 -- 10.20.193.12:0/3660914347 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f7570004cc0 con 0x7f7584115660 2026-02-13T21:18:29.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.116+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7584129300 con 0x7f7584115660 2026-02-13T21:18:29.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.117+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f405c10aba0 con 0x7f405c109920 2026-02-13T21:18:29.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.118+0000 7f40477fe640 1 -- 10.20.193.12:0/2102689457 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f4054038470 con 0x7f405c109920 2026-02-13T21:18:29.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.118+0000 7f40477fe640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f40380793f0 0x7f4038099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.118+0000 7f40477fe640 1 -- 10.20.193.12:0/2102689457 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f405403e070 con 0x7f405c109920 2026-02-13T21:18:29.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.118+0000 7f4061f71640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f40380793f0 0x7f4038099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.119+0000 7f4061f71640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f40380793f0 0x7f4038099900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f405c10d270 tx=0x7f4048009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.119+0000 7fe3a1ffb640 1 -- 10.20.193.12:0/1722097928 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fe3940697a0 con 0x7fe3ac10c250 2026-02-13T21:18:29.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f7580ff9640 1 -- 10.20.193.12:0/3660914347 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7570005660 con 0x7f7584115660 2026-02-13T21:18:29.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7584129830 con 0x7f7584115660 2026-02-13T21:18:29.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f7580ff9640 1 -- 10.20.193.12:0/3660914347 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f7570038470 con 0x7f7584115660 2026-02-13T21:18:29.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f7580ff9640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75580792c0 0x7f75580997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f7582ffd640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75580792c0 0x7f75580997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75841168e0 con 0x7f7584115660 2026-02-13T21:18:29.145 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f320f4fe640 1 -- 10.20.193.12:0/771450847 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109480 msgr2=0x7f3208109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.145 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f320f4fe640 1 --2- 10.20.193.12:0/771450847 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109480 0x7f3208109890 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009930 tx=0x7f31f802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.145 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/688071554 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 msgr2=0x7fb9e81507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.145 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7fb9ee7a9640 1 --2- 10.20.193.12:0/688071554 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 0x7fb9e81507a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009840 tx=0x7fb9d802f160 comp rx=0 tx=0).stop 2026-02-13T21:18:29.146 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f320f4fe640 1 -- 10.20.193.12:0/771450847 shutdown_connections 2026-02-13T21:18:29.146 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/688071554 shutdown_connections 2026-02-13T21:18:29.146 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f7582ffd640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75580792c0 0x7f75580997d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7584117f90 tx=0x7f7574009210 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.146 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f320f4fe640 1 --2- 10.20.193.12:0/771450847 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3208109dd0 0x7f3208152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.147 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7fb9ee7a9640 1 --2- 10.20.193.12:0/688071554 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 0x7fb9e81507a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.147 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7fb9ee7a9640 1 --2- 10.20.193.12:0/688071554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e810b900 0x7fb9e810bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.147 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f320f4fe640 1 --2- 10.20.193.12:0/771450847 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109480 0x7f3208109890 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.148 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/688071554 >> 10.20.193.12:0/688071554 conn(0x7fb9e80e70b0 msgr2=0x7fb9e8107500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.148 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/688071554 shutdown_connections 2026-02-13T21:18:29.148 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/688071554 wait complete. 2026-02-13T21:18:29.148 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.120+0000 7f320f4fe640 1 -- 10.20.193.12:0/771450847 >> 10.20.193.12:0/771450847 conn(0x7f32080e7010 msgr2=0x7f3208107460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.148 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7f320f4fe640 1 -- 10.20.193.12:0/771450847 shutdown_connections 2026-02-13T21:18:29.148 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7f320f4fe640 1 -- 10.20.193.12:0/771450847 wait complete. 2026-02-13T21:18:29.149 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9ee7a9640 1 Processor -- start 2026-02-13T21:18:29.149 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9ee7a9640 1 -- start start 2026-02-13T21:18:29.149 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9ee7a9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e810b900 0x7fb9e810aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.149 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9ee7a9640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 0x7fb9e81094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.149 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9ee7a9640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8153b50 con 0x7fb9e810c250 2026-02-13T21:18:29.149 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9ee7a9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e81539d0 con 0x7fb9e810b900 2026-02-13T21:18:29.150 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7f320f4fe640 1 Processor -- start 2026-02-13T21:18:29.150 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9e77fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 0x7fb9e81094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.150 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9e77fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 0x7fb9e81094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42418/0 (socket says 10.20.193.12:42418) 2026-02-13T21:18:29.150 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9e77fe640 1 -- 10.20.193.12:0/1090356674 learned_addr learned my addr 10.20.193.12:0/1090356674 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:29.150 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9e7fff640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e810b900 0x7fb9e810aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.150 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7f320f4fe640 1 -- start start 2026-02-13T21:18:29.151 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7f7580ff9640 1 -- 10.20.193.12:0/3660914347 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f757003e070 con 0x7f7584115660 2026-02-13T21:18:29.151 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9e77fe640 1 -- 10.20.193.12:0/1090356674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e810b900 msgr2=0x7fb9e810aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.151 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.121+0000 7fb9e77fe640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e810b900 0x7fb9e810aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.151 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7fb9e77fe640 1 -- 10.20.193.12:0/1090356674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e81099e0 con 0x7fb9e810c250 2026-02-13T21:18:29.151 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f40477fe640 1 -- 10.20.193.12:0/2102689457 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f405408de00 con 0x7f405c109920 2026-02-13T21:18:29.152 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7fb9e77fe640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 0x7fb9e81094a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8032040 tx=0x7fb9d8004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.152 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320f4fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3208109480 0x7f32080f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.152 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320f4fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109dd0 0x7f32080f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.152 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320f4fe640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3208155d80 con 0x7f3208109dd0 2026-02-13T21:18:29.152 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320f4fe640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3208155c00 con 0x7f3208109480 2026-02-13T21:18:29.153 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7fb9e57fa640 1 -- 10.20.193.12:0/1090356674 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb9d8046070 con 0x7fb9e810c250 2026-02-13T21:18:29.153 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7fb9e57fa640 1 -- 10.20.193.12:0/1090356674 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fb9d8002aa0 con 0x7fb9e810c250 2026-02-13T21:18:29.153 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7fb9e57fa640 1 -- 10.20.193.12:0/1090356674 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb9d8041630 con 0x7fb9e810c250 2026-02-13T21:18:29.153 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e8109c70 con 0x7fb9e810c250 2026-02-13T21:18:29.153 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320ca72640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109dd0 0x7f32080f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.153 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320d273640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3208109480 0x7f32080f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.153 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320ca72640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109dd0 0x7f32080f3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42430/0 (socket says 10.20.193.12:42430) 2026-02-13T21:18:29.154 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320ca72640 1 -- 10.20.193.12:0/2205550906 learned_addr learned my addr 10.20.193.12:0/2205550906 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:29.154 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e810a1a0 con 0x7fb9e810c250 2026-02-13T21:18:29.154 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320ca72640 1 -- 10.20.193.12:0/2205550906 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3208109480 msgr2=0x7f32080f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320ca72640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3208109480 0x7f32080f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320ca72640 1 -- 10.20.193.12:0/2205550906 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32080f8e70 con 0x7f3208109dd0 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320ca72640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109dd0 0x7f32080f3bb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c8c0 tx=0x7f31fc00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f31f67fc640 1 -- 10.20.193.12:0/2205550906 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f31fc013070 con 0x7f3208109dd0 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32080f9160 con 0x7f3208109dd0 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f31f67fc640 1 -- 10.20.193.12:0/2205550906 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f31fc007c30 con 0x7f3208109dd0 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f31f67fc640 1 -- 10.20.193.12:0/2205550906 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f31fc00f450 con 0x7f3208109dd0 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32080f9770 con 0x7f3208109dd0 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.122+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e8054f50 con 0x7fb9e810c250 2026-02-13T21:18:29.155 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3208054560 con 0x7f3208109dd0 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fe2f1dac640 1 -- 10.20.193.12:0/3855059554 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec108ed0 msgr2=0x7fe2ec1092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fe2f1dac640 1 --2- 10.20.193.12:0/3855059554 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec108ed0 0x7fe2ec1092e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009fd0 tx=0x7fe2d802f4d0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fe2f1dac640 1 -- 10.20.193.12:0/3855059554 shutdown_connections 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fe2f1dac640 1 --2- 10.20.193.12:0/3855059554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe2ec10d180 0x7fe2ec10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fe2f1dac640 1 --2- 10.20.193.12:0/3855059554 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec108ed0 0x7fe2ec1092e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fe2f1dac640 1 -- 10.20.193.12:0/3855059554 >> 10.20.193.12:0/3855059554 conn(0x7fe2ec060840 msgr2=0x7fe2ec060c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fe2f1dac640 1 -- 10.20.193.12:0/3855059554 shutdown_connections 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fe2f1dac640 1 -- 10.20.193.12:0/3855059554 wait complete. 2026-02-13T21:18:29.156 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.123+0000 7fb9e57fa640 1 -- 10.20.193.12:0/1090356674 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fb9d8038470 con 0x7fb9e810c250 2026-02-13T21:18:29.157 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7f31f67fc640 1 -- 10.20.193.12:0/2205550906 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f31fc00f670 con 0x7f3208109dd0 2026-02-13T21:18:29.157 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fb9e57fa640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb9bc0794c0 0x7fb9bc0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.157 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fb9e57fa640 1 -- 10.20.193.12:0/1090356674 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fb9d803e070 con 0x7fb9e810c250 2026-02-13T21:18:29.157 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fb9e7fff640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb9bc0794c0 0x7fb9bc0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.158 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2f1dac640 1 Processor -- start 2026-02-13T21:18:29.158 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2f1dac640 1 -- start start 2026-02-13T21:18:29.158 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fb9e7fff640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb9bc0794c0 0x7fb9bc0999d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4005b60 tx=0x7fb9d4009310 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.158 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7f31f67fc640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f31e40793f0 0x7f31e4099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.158 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2f1dac640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe2ec108ed0 0x7fe2ec114b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.158 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2f1dac640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec10d180 0x7fe2ec1150e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.159 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7f31f67fc640 1 -- 10.20.193.12:0/2205550906 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f31fc09c7f0 con 0x7f3208109dd0 2026-02-13T21:18:29.159 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2f1dac640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec10b3c0 con 0x7fe2ec10d180 2026-02-13T21:18:29.159 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2f1dac640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec10b240 con 0x7fe2ec108ed0 2026-02-13T21:18:29.159 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7f320d273640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f31e40793f0 0x7f31e4099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2eaffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec10d180 0x7fe2ec1150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2eaffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec10d180 0x7fe2ec1150e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42442/0 (socket says 10.20.193.12:42442) 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2eaffd640 1 -- 10.20.193.12:0/1101444879 learned_addr learned my addr 10.20.193.12:0/1101444879 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2eb7fe640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe2ec108ed0 0x7fe2ec114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2eaffd640 1 -- 10.20.193.12:0/1101444879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe2ec108ed0 msgr2=0x7fe2ec114b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2eaffd640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe2ec108ed0 0x7fe2ec114b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2eaffd640 1 -- 10.20.193.12:0/1101444879 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec11a3a0 con 0x7fe2ec10d180 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7f320d273640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f31e40793f0 0x7f31e4099900 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009900 tx=0x7f31f8031040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.124+0000 7fe2eaffd640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec10d180 0x7fe2ec1150e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00d6a0 tx=0x7fe2dc00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.160 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.125+0000 7f7580ff9640 1 -- 10.20.193.12:0/3660914347 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f757008f050 con 0x7f7584115660 2026-02-13T21:18:29.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.127+0000 7fb9e57fa640 1 -- 10.20.193.12:0/1090356674 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fb9d808de40 con 0x7fb9e810c250 2026-02-13T21:18:29.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.131+0000 7fe2e8ff9640 1 -- 10.20.193.12:0/1101444879 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe2dc014070 con 0x7fe2ec10d180 2026-02-13T21:18:29.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.131+0000 7fe2e8ff9640 1 -- 10.20.193.12:0/1101444879 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fe2dc00b840 con 0x7fe2ec10d180 2026-02-13T21:18:29.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.131+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ec11a690 con 0x7fe2ec10d180 2026-02-13T21:18:29.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.131+0000 7fe2e8ff9640 1 -- 10.20.193.12:0/1101444879 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe2dc002bc0 con 0x7fe2ec10d180 2026-02-13T21:18:29.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.131+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ec11aca0 con 0x7fe2ec10d180 2026-02-13T21:18:29.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.131+0000 7f31f67fc640 1 -- 10.20.193.12:0/2205550906 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f31fc069910 con 0x7f3208109dd0 2026-02-13T21:18:29.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.131+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ec054520 con 0x7fe2ec10d180 2026-02-13T21:18:29.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.132+0000 7fe2e8ff9640 1 -- 10.20.193.12:0/1101444879 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fe2dc010460 con 0x7fe2ec10d180 2026-02-13T21:18:29.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.132+0000 7fe2e8ff9640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe2c00794c0 0x7fe2c00999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:29.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.133+0000 7fe2eb7fe640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe2c00794c0 0x7fe2c00999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:29.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.133+0000 7fe2e8ff9640 1 -- 10.20.193.12:0/1101444879 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fe2dc09c690 con 0x7fe2ec10d180 2026-02-13T21:18:29.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.133+0000 7fe2eb7fe640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe2c00794c0 0x7fe2c00999d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800c090 tx=0x7fe2d8006230 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:29.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.136+0000 7fe2e8ff9640 1 -- 10.20.193.12:0/1101444879 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fe2dc0697b0 con 0x7fe2ec10d180 2026-02-13T21:18:29.232 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.228+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9fc40fd970 con 0x7f9fc410b790 2026-02-13T21:18:29.232 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.228+0000 7f9fc8813640 1 -- 10.20.193.12:0/2260901142 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9fb806edf0 con 0x7f9fc410b790 2026-02-13T21:18:29.232 INFO:teuthology.orchestra.run.trial012.stdout:141733920773 2026-02-13T21:18:29.234 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.230+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9f98079570 msgr2=0x7f9f98099a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.234 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.230+0000 7f9fc9815640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9f98079570 0x7f9f98099a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40e98a0 tx=0x7f9fac03a040 comp rx=0 tx=0).stop 2026-02-13T21:18:29.234 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.230+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410b790 msgr2=0x7f9fc40f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.234 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.230+0000 7f9fc9815640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410b790 0x7f9fc40f74c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80094b0 tx=0x7f9fb800ede0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.234 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.231+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 shutdown_connections 2026-02-13T21:18:29.235 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.231+0000 7f9fc9815640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9f98079570 0x7f9f98099a80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.235 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.231+0000 7f9fc9815640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9fc410c1c0 0x7f9fc40f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.235 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.231+0000 7f9fc9815640 1 --2- 10.20.193.12:0/2260901142 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9fc410b790 0x7f9fc40f74c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.235 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.231+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 >> 10.20.193.12:0/2260901142 conn(0x7f9fc40e70b0 msgr2=0x7f9fc40ef810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.235 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.231+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 shutdown_connections 2026-02-13T21:18:29.235 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.231+0000 7f9fc9815640 1 -- 10.20.193.12:0/2260901142 wait complete. 2026-02-13T21:18:29.237 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.234+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fadf4127300 con 0x7fadf4108db0 2026-02-13T21:18:29.237 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.234+0000 7fadd3fff640 1 -- 10.20.193.12:0/3285756408 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fade8069c20 con 0x7fadf4108db0 2026-02-13T21:18:29.238 INFO:teuthology.orchestra.run.trial012.stdout:103079215113 2026-02-13T21:18:29.239 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.236+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe374005680 con 0x7fe3ac10c250 2026-02-13T21:18:29.240 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.236+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fadc80793f0 msgr2=0x7fadc8099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.240 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.236+0000 7fadf977f640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fadc80793f0 0x7fadc8099900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faddc005fa0 tx=0x7faddc03a040 comp rx=0 tx=0).stop 2026-02-13T21:18:29.240 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.236+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4108db0 msgr2=0x7fadf4120eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.240 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.237+0000 7fadf977f640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4108db0 0x7fadf4120eb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fade80026d0 tx=0x7fade8002ba0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.240 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.236+0000 7fe3a1ffb640 1 -- 10.20.193.12:0/1722097928 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe39406e8a0 con 0x7fe3ac10c250 2026-02-13T21:18:29.240 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.237+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 shutdown_connections 2026-02-13T21:18:29.241 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.237+0000 7fadf977f640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fadc80793f0 0x7fadc8099900 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.241 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.237+0000 7fadf977f640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadf4109700 0x7fadf4121430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.241 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.237+0000 7fadf977f640 1 --2- 10.20.193.12:0/3285756408 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fadf4108db0 0x7fadf4120eb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.241 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.237+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 >> 10.20.193.12:0/3285756408 conn(0x7fadf4060840 msgr2=0x7fadf410bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.241 INFO:teuthology.orchestra.run.trial012.stdout:188978561026 2026-02-13T21:18:29.241 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.237+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 shutdown_connections 2026-02-13T21:18:29.241 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.237+0000 7fadf977f640 1 -- 10.20.193.12:0/3285756408 wait complete. 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe3880794c0 msgr2=0x7fe3880999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe3880794c0 0x7fe3880999d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe39c005b60 tx=0x7fe39c03a040 comp rx=0 tx=0).stop 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10c250 msgr2=0x7fe3ac108500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10c250 0x7fe3ac108500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe39400d6d0 tx=0x7fe39400dba0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 shutdown_connections 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe3880794c0 0x7fe3880999d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe3ac10c250 0x7fe3ac108500 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 --2- 10.20.193.12:0/1722097928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3ac10b900 0x7fe3ac107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 >> 10.20.193.12:0/1722097928 conn(0x7fe3ac0e70b0 msgr2=0x7fe3ac0ef900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 shutdown_connections 2026-02-13T21:18:29.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7fe3b2d95640 1 -- 10.20.193.12:0/1722097928 wait complete. 2026-02-13T21:18:29.244 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.239+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f405c0f80b0 con 0x7f405c109920 2026-02-13T21:18:29.244 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.240+0000 7f40477fe640 1 -- 10.20.193.12:0/2102689457 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4054092f00 con 0x7f405c109920 2026-02-13T21:18:29.244 INFO:teuthology.orchestra.run.trial012.stdout:120259084294 2026-02-13T21:18:29.246 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f40380793f0 msgr2=0x7f4038099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.246 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f40380793f0 0x7f4038099900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f405c10d270 tx=0x7f4048009260 comp rx=0 tx=0).stop 2026-02-13T21:18:29.246 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c109920 msgr2=0x7f405c0f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.246 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c109920 0x7f405c0f1e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4054005fd0 tx=0x7f4054002c70 comp rx=0 tx=0).stop 2026-02-13T21:18:29.246 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 shutdown_connections 2026-02-13T21:18:29.247 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f40380793f0 0x7f4038099900 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.247 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f405c10f260 0x7f405c0f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.247 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 --2- 10.20.193.12:0/2102689457 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c109920 0x7f405c0f1e00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.247 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 >> 10.20.193.12:0/2102689457 conn(0x7f405c0e7080 msgr2=0x7f405c054850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.247 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 shutdown_connections 2026-02-13T21:18:29.247 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.242+0000 7f40649fd640 1 -- 10.20.193.12:0/2102689457 wait complete. 2026-02-13T21:18:29.247 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.243+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7584129a60 con 0x7f7584115660 2026-02-13T21:18:29.248 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.243+0000 7f7580ff9640 1 -- 10.20.193.12:0/3660914347 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7570094150 con 0x7f7584115660 2026-02-13T21:18:29.248 INFO:teuthology.orchestra.run.trial012.stdout:38654705677 2026-02-13T21:18:29.248 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.243+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb9e814c680 con 0x7fb9e810c250 2026-02-13T21:18:29.248 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.244+0000 7fb9e57fa640 1 -- 10.20.193.12:0/1090356674 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9d8092f40 con 0x7fb9e810c250 2026-02-13T21:18:29.249 INFO:teuthology.orchestra.run.trial012.stdout:55834574861 2026-02-13T21:18:29.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75580792c0 msgr2=0x7f75580997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75580792c0 0x7f75580997d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7584117f90 tx=0x7f7574009210 comp rx=0 tx=0).stop 2026-02-13T21:18:29.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7584115660 msgr2=0x7f7584123830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7584115660 0x7f7584123830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7570005fa0 tx=0x7f7570004740 comp rx=0 tx=0).stop 2026-02-13T21:18:29.250 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 shutdown_connections 2026-02-13T21:18:29.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75580792c0 0x7f75580997d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f758411afa0 0x7f7584123db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 --2- 10.20.193.12:0/3660914347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7584115660 0x7f7584123830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 >> 10.20.193.12:0/3660914347 conn(0x7f75840572a0 msgr2=0x7f75841190e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 shutdown_connections 2026-02-13T21:18:29.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.246+0000 7f7589eff640 1 -- 10.20.193.12:0/3660914347 wait complete. 2026-02-13T21:18:29.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb9bc0794c0 msgr2=0x7fb9bc0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb9bc0794c0 0x7fb9bc0999d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4005b60 tx=0x7fb9d4009310 comp rx=0 tx=0).stop 2026-02-13T21:18:29.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 msgr2=0x7fb9e81094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 0x7fb9e81094a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8032040 tx=0x7fb9d8004660 comp rx=0 tx=0).stop 2026-02-13T21:18:29.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 shutdown_connections 2026-02-13T21:18:29.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb9bc0794c0 0x7fb9bc0999d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb9e810c250 0x7fb9e81094a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 --2- 10.20.193.12:0/1090356674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e810b900 0x7fb9e810aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 >> 10.20.193.12:0/1090356674 conn(0x7fb9e80e70b0 msgr2=0x7fb9e80ef960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 shutdown_connections 2026-02-13T21:18:29.253 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.247+0000 7fb9ee7a9640 1 -- 10.20.193.12:0/1090356674 wait complete. 2026-02-13T21:18:29.263 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.259+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f32080f9b50 con 0x7f3208109dd0 2026-02-13T21:18:29.263 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.260+0000 7f31f67fc640 1 -- 10.20.193.12:0/2205550906 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31fc06ea10 con 0x7f3208109dd0 2026-02-13T21:18:29.263 INFO:teuthology.orchestra.run.trial012.stdout:77309411338 2026-02-13T21:18:29.267 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.263+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f31e40793f0 msgr2=0x7f31e4099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.267 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.263+0000 7f320f4fe640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f31e40793f0 0x7f31e4099900 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009900 tx=0x7f31f8031040 comp rx=0 tx=0).stop 2026-02-13T21:18:29.267 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.263+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109dd0 msgr2=0x7f32080f3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.267 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.263+0000 7f320f4fe640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109dd0 0x7f32080f3bb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c8c0 tx=0x7f31fc00cd90 comp rx=0 tx=0).stop 2026-02-13T21:18:29.269 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.265+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 shutdown_connections 2026-02-13T21:18:29.269 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.265+0000 7f320f4fe640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f31e40793f0 0x7f31e4099900 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.269 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.265+0000 7f320f4fe640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3208109dd0 0x7f32080f3bb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.269 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.265+0000 7f320f4fe640 1 --2- 10.20.193.12:0/2205550906 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3208109480 0x7f32080f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.269 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.265+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 >> 10.20.193.12:0/2205550906 conn(0x7f32080e7010 msgr2=0x7f32080edc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.269 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.265+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 shutdown_connections 2026-02-13T21:18:29.269 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.265+0000 7f320f4fe640 1 -- 10.20.193.12:0/2205550906 wait complete. 2026-02-13T21:18:29.270 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.265+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe2ec11af50 con 0x7fe2ec10d180 2026-02-13T21:18:29.270 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.267+0000 7fe2e8ff9640 1 -- 10.20.193.12:0/1101444879 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe2dc06e8b0 con 0x7fe2ec10d180 2026-02-13T21:18:29.271 INFO:teuthology.orchestra.run.trial012.stdout:167503724548 2026-02-13T21:18:29.275 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe2c00794c0 msgr2=0x7fe2c00999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.275 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe2c00794c0 0x7fe2c00999d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800c090 tx=0x7fe2d8006230 comp rx=0 tx=0).stop 2026-02-13T21:18:29.275 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec10d180 msgr2=0x7fe2ec1150e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:29.275 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec10d180 0x7fe2ec1150e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00d6a0 tx=0x7fe2dc00db70 comp rx=0 tx=0).stop 2026-02-13T21:18:29.275 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 shutdown_connections 2026-02-13T21:18:29.275 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe2c00794c0 0x7fe2c00999d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.275 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe2ec10d180 0x7fe2ec1150e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.275 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 --2- 10.20.193.12:0/1101444879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe2ec108ed0 0x7fe2ec114b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:29.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 >> 10.20.193.12:0/1101444879 conn(0x7fe2ec060840 msgr2=0x7fe2ec107830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:29.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 shutdown_connections 2026-02-13T21:18:29.276 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:29.271+0000 7fe2f1dac640 1 -- 10.20.193.12:0/1101444879 wait complete. 2026-02-13T21:18:29.291 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920775 got 141733920773 for osd.5 2026-02-13T21:18:29.311 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561027 got 188978561026 for osd.7 2026-02-13T21:18:29.355 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411339 got 77309411338 for osd.2 2026-02-13T21:18:29.356 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215114 got 103079215113 for osd.3 2026-02-13T21:18:29.375 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084295 got 120259084294 for osd.4 2026-02-13T21:18:29.376 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724549 got 167503724548 for osd.6 2026-02-13T21:18:29.384 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705678 got 38654705677 for osd.0 2026-02-13T21:18:29.395 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.1 2026-02-13T21:18:29.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/638403428' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:29.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2260901142' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T21:18:29.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3285756408' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T21:18:29.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1722097928' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T21:18:29.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2102689457' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T21:18:29.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1090356674' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T21:18:29.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3660914347' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T21:18:29.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2205550906' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T21:18:29.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:29 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1101444879' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T21:18:29.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/638403428' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:29.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2260901142' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T21:18:29.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3285756408' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T21:18:29.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1722097928' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T21:18:29.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2102689457' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T21:18:29.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1090356674' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T21:18:29.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3660914347' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T21:18:29.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2205550906' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T21:18:29.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:29 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1101444879' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T21:18:30.292 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T21:18:30.312 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T21:18:30.356 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T21:18:30.356 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T21:18:30.357 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:30 trial012 ceph-mon[37926]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:30.376 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T21:18:30.376 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T21:18:30.386 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T21:18:30.396 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T21:18:30.410 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:30.462 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:30.482 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:30.484 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:30.530 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:30.531 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:30.531 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:30.532 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.542+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/3262435852 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b0810aa00 msgr2=0x7f7b0810ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.542+0000 7f7b0ddd3640 1 --2- 10.20.193.12:0/3262435852 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b0810aa00 0x7f7b0810ae10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005fd0 tx=0x7f7af402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.542+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/3262435852 shutdown_connections 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.542+0000 7f7b0ddd3640 1 --2- 10.20.193.12:0/3262435852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7b08110340 0x7f7b08110750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.542+0000 7f7b0ddd3640 1 --2- 10.20.193.12:0/3262435852 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b0810aa00 0x7f7b0810ae10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.542+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/3262435852 >> 10.20.193.12:0/3262435852 conn(0x7f7b080e8180 msgr2=0x7f7b081085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.542+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/3262435852 shutdown_connections 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.542+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/3262435852 wait complete. 2026-02-13T21:18:30.547 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b0ddd3640 1 Processor -- start 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b0ddd3640 1 -- start start 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b0ddd3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7b0810aa00 0x7f7b08118b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b0ddd3640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b08110340 0x7f7b081190e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b0ddd3640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081518c0 con 0x7f7b08110340 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b0ddd3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7b08151740 con 0x7f7b0810aa00 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b06ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b08110340 0x7f7b081190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b077fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7b0810aa00 0x7f7b08118b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b06ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b08110340 0x7f7b081190e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42466/0 (socket says 10.20.193.12:42466) 2026-02-13T21:18:30.548 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b06ffd640 1 -- 10.20.193.12:0/805490861 learned_addr learned my addr 10.20.193.12:0/805490861 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:30.550 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b06ffd640 1 -- 10.20.193.12:0/805490861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7b0810aa00 msgr2=0x7f7b08118b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.550 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b06ffd640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7b0810aa00 0x7f7b08118b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.550 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b06ffd640 1 -- 10.20.193.12:0/805490861 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0811e3a0 con 0x7f7b08110340 2026-02-13T21:18:30.550 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.543+0000 7f7b06ffd640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b08110340 0x7f7b081190e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7af80095a0 tx=0x7f7af800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.550 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.544+0000 7f7b04ff9640 1 -- 10.20.193.12:0/805490861 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7af800cac0 con 0x7f7b08110340 2026-02-13T21:18:30.550 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.544+0000 7f7b04ff9640 1 -- 10.20.193.12:0/805490861 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f7af8004d10 con 0x7f7b08110340 2026-02-13T21:18:30.550 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.544+0000 7f7b04ff9640 1 -- 10.20.193.12:0/805490861 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7af80056b0 con 0x7f7b08110340 2026-02-13T21:18:30.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.544+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0811e690 con 0x7f7b08110340 2026-02-13T21:18:30.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.544+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b0811ec40 con 0x7f7b08110340 2026-02-13T21:18:30.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.544+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b0810bc80 con 0x7f7b08110340 2026-02-13T21:18:30.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.545+0000 7f7b04ff9640 1 -- 10.20.193.12:0/805490861 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f7af80047a0 con 0x7f7b08110340 2026-02-13T21:18:30.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.546+0000 7f7b04ff9640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7adc079590 0x7f7adc099aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.546+0000 7f7b04ff9640 1 -- 10.20.193.12:0/805490861 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f7af809c8e0 con 0x7f7b08110340 2026-02-13T21:18:30.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.546+0000 7f7b077fe640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7adc079590 0x7f7adc099aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.551 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.546+0000 7f7b077fe640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7adc079590 0x7f7adc099aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009900 tx=0x7f7af4031040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.552 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.549+0000 7f7b04ff9640 1 -- 10.20.193.12:0/805490861 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f7af8069a80 con 0x7f7b08110340 2026-02-13T21:18:30.600 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.597+0000 7fcc35c74640 1 -- 10.20.193.12:0/4163813154 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 msgr2=0x7fcc30109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.597+0000 7fcc35c74640 1 --2- 10.20.193.12:0/4163813154 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 0x7fcc30109890 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009930 tx=0x7fcc1c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.597+0000 7fcc35c74640 1 -- 10.20.193.12:0/4163813154 shutdown_connections 2026-02-13T21:18:30.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.597+0000 7fcc35c74640 1 --2- 10.20.193.12:0/4163813154 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30109dd0 0x7fcc30152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.597+0000 7fcc35c74640 1 --2- 10.20.193.12:0/4163813154 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 0x7fcc30109890 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.597+0000 7fcc35c74640 1 -- 10.20.193.12:0/4163813154 >> 10.20.193.12:0/4163813154 conn(0x7fcc300e7010 msgr2=0x7fcc30107460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.597+0000 7fcc35c74640 1 -- 10.20.193.12:0/4163813154 shutdown_connections 2026-02-13T21:18:30.601 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.597+0000 7fcc35c74640 1 -- 10.20.193.12:0/4163813154 wait complete. 2026-02-13T21:18:30.603 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc35c74640 1 Processor -- start 2026-02-13T21:18:30.604 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc35c74640 1 -- start start 2026-02-13T21:18:30.604 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc35c74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 0x7fcc300f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.604 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc35c74640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30109dd0 0x7fcc300f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.604 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc35c74640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc30155d80 con 0x7fcc30109480 2026-02-13T21:18:30.604 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc35c74640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc30155c00 con 0x7fcc30109dd0 2026-02-13T21:18:30.604 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc2f7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 0x7fcc300f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.604 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc2f7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 0x7fcc300f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42482/0 (socket says 10.20.193.12:42482) 2026-02-13T21:18:30.604 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc2f7fe640 1 -- 10.20.193.12:0/1596106330 learned_addr learned my addr 10.20.193.12:0/1596106330 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.598+0000 7fcc2effd640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30109dd0 0x7fcc300f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc2f7fe640 1 -- 10.20.193.12:0/1596106330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30109dd0 msgr2=0x7fcc300f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc2f7fe640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30109dd0 0x7fcc300f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc2f7fe640 1 -- 10.20.193.12:0/1596106330 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc300f9020 con 0x7fcc30109480 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc2effd640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30109dd0 0x7fcc300f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc2f7fe640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 0x7fcc300f37e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c005a20 tx=0x7fcc1c002db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc2cff9640 1 -- 10.20.193.12:0/1596106330 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcc1c046070 con 0x7fcc30109480 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc300f92b0 con 0x7fcc30109480 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc300f9860 con 0x7fcc30109480 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc2cff9640 1 -- 10.20.193.12:0/1596106330 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fcc1c0044b0 con 0x7fcc30109480 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.599+0000 7fcc2cff9640 1 -- 10.20.193.12:0/1596106330 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcc1c0416c0 con 0x7fcc30109480 2026-02-13T21:18:30.605 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.600+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc30054560 con 0x7fcc30109480 2026-02-13T21:18:30.606 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7fcc2cff9640 1 -- 10.20.193.12:0/1596106330 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fcc1c038a00 con 0x7fcc30109480 2026-02-13T21:18:30.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/1539496092 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac05c2d0 msgr2=0x7f3cac05c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 --2- 10.20.193.12:0/1539496092 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac05c2d0 0x7f3cac05c6e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0005fd0 tx=0x7f3ca002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/1539496092 shutdown_connections 2026-02-13T21:18:30.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 --2- 10.20.193.12:0/1539496092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cac116ba0 0x7f3cac116fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 --2- 10.20.193.12:0/1539496092 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac05c2d0 0x7f3cac05c6e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/1539496092 >> 10.20.193.12:0/1539496092 conn(0x7f3cac059bc0 msgr2=0x7f3cac05a710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.607 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/1539496092 shutdown_connections 2026-02-13T21:18:30.608 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7fcc2cff9640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcbfc079590 0x7fcbfc099aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.608 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7fcc2cff9640 1 -- 10.20.193.12:0/1596106330 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fcc1c03e070 con 0x7fcc30109480 2026-02-13T21:18:30.608 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7fcc2effd640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcbfc079590 0x7fcbfc099aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.608 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/1539496092 wait complete. 2026-02-13T21:18:30.608 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7fcc2effd640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcbfc079590 0x7fcbfc099aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc300e7da0 tx=0x7fcc200073d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.601+0000 7f3cb0ea6640 1 Processor -- start 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3cb0ea6640 1 -- start start 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3cb0ea6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cac05c2d0 0x7f3cac103f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3cb0ea6640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac116ba0 0x7f3cac104450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3cb0ea6640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac15c520 con 0x7f3cac116ba0 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3cb0ea6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac15c3a0 con 0x7f3cac05c2d0 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3ca9d74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac116ba0 0x7f3cac104450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3caa575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cac05c2d0 0x7f3cac103f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3ca9d74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac116ba0 0x7f3cac104450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42510/0 (socket says 10.20.193.12:42510) 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3ca9d74640 1 -- 10.20.193.12:0/171847192 learned_addr learned my addr 10.20.193.12:0/171847192 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:30.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3ca9d74640 1 -- 10.20.193.12:0/171847192 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cac05c2d0 msgr2=0x7f3cac103f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.611 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3ca9d74640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cac05c2d0 0x7f3cac103f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.611 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3ca9d74640 1 -- 10.20.193.12:0/171847192 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac104b50 con 0x7f3cac116ba0 2026-02-13T21:18:30.611 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.602+0000 7f3ca9d74640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac116ba0 0x7f3cac104450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005de0 tx=0x7f3c9400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.611 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.604+0000 7fcc2cff9640 1 -- 10.20.193.12:0/1596106330 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fcc1c050080 con 0x7fcc30109480 2026-02-13T21:18:30.612 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.604+0000 7f3c937fe640 1 -- 10.20.193.12:0/171847192 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3c94014070 con 0x7f3cac116ba0 2026-02-13T21:18:30.612 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.604+0000 7f3c937fe640 1 -- 10.20.193.12:0/171847192 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f3c940044a0 con 0x7f3cac116ba0 2026-02-13T21:18:30.612 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.604+0000 7f3c937fe640 1 -- 10.20.193.12:0/171847192 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3c94002cc0 con 0x7f3cac116ba0 2026-02-13T21:18:30.612 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.604+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac109820 con 0x7f3cac116ba0 2026-02-13T21:18:30.612 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.604+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac109d80 con 0x7f3cac116ba0 2026-02-13T21:18:30.612 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.605+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cac05d260 con 0x7f3cac116ba0 2026-02-13T21:18:30.612 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.606+0000 7f3c937fe640 1 -- 10.20.193.12:0/171847192 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f3c9400b840 con 0x7f3cac116ba0 2026-02-13T21:18:30.613 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.606+0000 7f3c937fe640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f3c840794c0 0x7f3c840999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.613 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.607+0000 7f3caa575640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f3c840794c0 0x7f3c840999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.613 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.607+0000 7f3c937fe640 1 -- 10.20.193.12:0/171847192 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f3c9409c630 con 0x7f3cac116ba0 2026-02-13T21:18:30.613 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.607+0000 7f3caa575640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f3c840794c0 0x7f3c840999d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009900 tx=0x7f3ca0031040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.613 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.609+0000 7f3c937fe640 1 -- 10.20.193.12:0/171847192 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f3c9400bb60 con 0x7f3cac116ba0 2026-02-13T21:18:30.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 -- 10.20.193.12:0/1895506738 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 msgr2=0x7ff3f4108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 --2- 10.20.193.12:0/1895506738 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 0x7ff3f4108d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009fd0 tx=0x7ff3e802f4d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 -- 10.20.193.12:0/1895506738 shutdown_connections 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 --2- 10.20.193.12:0/1895506738 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3f4110360 0x7ff3f4110770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 --2- 10.20.193.12:0/1895506738 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 0x7ff3f4108d30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 -- 10.20.193.12:0/1895506738 >> 10.20.193.12:0/1895506738 conn(0x7ff3f40e6340 msgr2=0x7ff3f4106790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 -- 10.20.193.12:0/1895506738 shutdown_connections 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 -- 10.20.193.12:0/1895506738 wait complete. 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 Processor -- start 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.610+0000 7ff3f943a640 1 -- start start 2026-02-13T21:18:30.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f943a640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 0x7ff3f4118bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f943a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3f4110360 0x7ff3f4119150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f943a640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f41518a0 con 0x7ff3f4108920 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f943a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f4151720 con 0x7ff3f4110360 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f2ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 0x7ff3f4118bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f2ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 0x7ff3f4118bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42528/0 (socket says 10.20.193.12:42528) 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f2ffd640 1 -- 10.20.193.12:0/429731188 learned_addr learned my addr 10.20.193.12:0/429731188 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f27fc640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3f4110360 0x7ff3f4119150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f2ffd640 1 -- 10.20.193.12:0/429731188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3f4110360 msgr2=0x7ff3f4119150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f2ffd640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3f4110360 0x7ff3f4119150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f2ffd640 1 -- 10.20.193.12:0/429731188 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f411e410 con 0x7ff3f4108920 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f2ffd640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 0x7ff3f4118bd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800c090 tx=0x7ff3e8009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.617 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3d3fff640 1 -- 10.20.193.12:0/429731188 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ff3e8004700 con 0x7ff3f4108920 2026-02-13T21:18:30.618 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f411e6a0 con 0x7ff3f4108920 2026-02-13T21:18:30.618 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3d3fff640 1 -- 10.20.193.12:0/429731188 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7ff3e8007590 con 0x7ff3f4108920 2026-02-13T21:18:30.618 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3d3fff640 1 -- 10.20.193.12:0/429731188 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ff3e8042640 con 0x7ff3f4108920 2026-02-13T21:18:30.618 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.611+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f411ec50 con 0x7ff3f4108920 2026-02-13T21:18:30.618 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.612+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f41099e0 con 0x7ff3f4108920 2026-02-13T21:18:30.619 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.613+0000 7ff3d3fff640 1 -- 10.20.193.12:0/429731188 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7ff3e8007740 con 0x7ff3f4108920 2026-02-13T21:18:30.619 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.613+0000 7ff3d3fff640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff3c80794c0 0x7ff3c80999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.619 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.613+0000 7ff3d3fff640 1 -- 10.20.193.12:0/429731188 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7ff3e80c11a0 con 0x7ff3f4108920 2026-02-13T21:18:30.619 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.613+0000 7ff3f27fc640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff3c80794c0 0x7ff3c80999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.619 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.613+0000 7ff3f27fc640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff3c80794c0 0x7ff3c80999d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3f410eb10 tx=0x7ff3dc005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.620 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.616+0000 7ff3d3fff640 1 -- 10.20.193.12:0/429731188 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7ff3e8050080 con 0x7ff3f4108920 2026-02-13T21:18:30.670 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.666+0000 7f75c9456640 1 -- 10.20.193.12:0/2162933607 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c4108ed0 msgr2=0x7f75c41092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.670 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.666+0000 7f75c9456640 1 --2- 10.20.193.12:0/2162933607 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c4108ed0 0x7f75c41092e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f75b8005fd0 tx=0x7f75b802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.666+0000 7f75c9456640 1 -- 10.20.193.12:0/2162933607 shutdown_connections 2026-02-13T21:18:30.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.666+0000 7f75c9456640 1 --2- 10.20.193.12:0/2162933607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f75c410d180 0x7f75c410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.666+0000 7f75c9456640 1 --2- 10.20.193.12:0/2162933607 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c4108ed0 0x7f75c41092e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.666+0000 7f75c9456640 1 -- 10.20.193.12:0/2162933607 >> 10.20.193.12:0/2162933607 conn(0x7f75c4060840 msgr2=0x7f75c4060c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c9456640 1 -- 10.20.193.12:0/2162933607 shutdown_connections 2026-02-13T21:18:30.671 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c9456640 1 -- 10.20.193.12:0/2162933607 wait complete. 2026-02-13T21:18:30.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c9456640 1 Processor -- start 2026-02-13T21:18:30.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/2840387696 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 msgr2=0x7f3a081092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f3a0d9f9640 1 --2- 10.20.193.12:0/2840387696 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 0x7f3a081092e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f39fc005fd0 tx=0x7f39fc02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.672 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c9456640 1 -- start start 2026-02-13T21:18:30.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/2840387696 shutdown_connections 2026-02-13T21:18:30.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f3a0d9f9640 1 --2- 10.20.193.12:0/2840387696 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a0810d180 0x7f3a0810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f3a0d9f9640 1 --2- 10.20.193.12:0/2840387696 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 0x7f3a081092e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/2840387696 >> 10.20.193.12:0/2840387696 conn(0x7f3a08060840 msgr2=0x7f3a08060c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.673 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/2840387696 shutdown_connections 2026-02-13T21:18:30.674 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/2840387696 wait complete. 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c9456640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f75c4108ed0 0x7f75c41194d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c9456640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c410d180 0x7f75c4119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c9456640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4153b80 con 0x7f75c410d180 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c9456640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4153a00 con 0x7f75c4108ed0 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c27fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c410d180 0x7f75c4119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c27fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c410d180 0x7f75c4119a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42564/0 (socket says 10.20.193.12:42564) 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.667+0000 7f75c27fc640 1 -- 10.20.193.12:0/948745490 learned_addr learned my addr 10.20.193.12:0/948745490 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75c2ffd640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f75c4108ed0 0x7f75c41194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75c27fc640 1 -- 10.20.193.12:0/948745490 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f75c4108ed0 msgr2=0x7f75c41194d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.675 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75c27fc640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f75c4108ed0 0x7f75c41194d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.676 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75c27fc640 1 -- 10.20.193.12:0/948745490 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c411ed10 con 0x7f75c410d180 2026-02-13T21:18:30.676 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75c27fc640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c410d180 0x7f75c4119a50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0095a0 tx=0x7f75ac00ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.676 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a0d9f9640 1 Processor -- start 2026-02-13T21:18:30.676 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a0d9f9640 1 -- start start 2026-02-13T21:18:30.677 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75a3fff640 1 -- 10.20.193.12:0/948745490 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f75ac00cac0 con 0x7f75c410d180 2026-02-13T21:18:30.677 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75a3fff640 1 -- 10.20.193.12:0/948745490 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f75ac004d10 con 0x7f75c410d180 2026-02-13T21:18:30.677 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c411f000 con 0x7f75c410d180 2026-02-13T21:18:30.677 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75a3fff640 1 -- 10.20.193.12:0/948745490 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f75ac0056b0 con 0x7f75c410d180 2026-02-13T21:18:30.678 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c411f610 con 0x7f75c410d180 2026-02-13T21:18:30.679 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a0d9f9640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 0x7f3a08109eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.679 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a0d9f9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a0810d180 0x7f3a0810a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.679 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a0d9f9640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a08153b80 con 0x7f3a08108ed0 2026-02-13T21:18:30.679 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a0d9f9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a08153a00 con 0x7f3a0810d180 2026-02-13T21:18:30.679 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a06ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 0x7f3a08109eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.679 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a06ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 0x7f3a08109eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42568/0 (socket says 10.20.193.12:42568) 2026-02-13T21:18:30.679 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a06ffd640 1 -- 10.20.193.12:0/1323738097 learned_addr learned my addr 10.20.193.12:0/1323738097 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:30.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a067fc640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a0810d180 0x7f3a0810a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a06ffd640 1 -- 10.20.193.12:0/1323738097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a0810d180 msgr2=0x7f3a0810a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a06ffd640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a0810d180 0x7f3a0810a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.680 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.668+0000 7f3a06ffd640 1 -- 10.20.193.12:0/1323738097 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0810a930 con 0x7f3a08108ed0 2026-02-13T21:18:30.681 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 -- 10.20.193.12:0/423623103 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1168108ed0 msgr2=0x7f11681092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.681 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 --2- 10.20.193.12:0/423623103 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1168108ed0 0x7f11681092e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f115c005fd0 tx=0x7f115c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.681 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 -- 10.20.193.12:0/423623103 shutdown_connections 2026-02-13T21:18:30.681 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 --2- 10.20.193.12:0/423623103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f116810d180 0x7f116810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.681 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 --2- 10.20.193.12:0/423623103 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1168108ed0 0x7f11681092e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.681 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 -- 10.20.193.12:0/423623103 >> 10.20.193.12:0/423623103 conn(0x7f1168060840 msgr2=0x7f1168060c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.681 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 -- 10.20.193.12:0/423623103 shutdown_connections 2026-02-13T21:18:30.681 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c4054520 con 0x7f75c410d180 2026-02-13T21:18:30.682 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f3a06ffd640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 0x7f3a08109eb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0092b0 tx=0x7f39fc002db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.682 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f3a0c9f7640 1 -- 10.20.193.12:0/1323738097 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f39fc046070 con 0x7f3a08108ed0 2026-02-13T21:18:30.682 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f3a0c9f7640 1 -- 10.20.193.12:0/1323738097 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f39fc004560 con 0x7f3a08108ed0 2026-02-13T21:18:30.682 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0810abc0 con 0x7f3a08108ed0 2026-02-13T21:18:30.682 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a08141990 con 0x7f3a08108ed0 2026-02-13T21:18:30.683 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7b0811efe0 con 0x7f7b08110340 2026-02-13T21:18:30.683 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f3a0c9f7640 1 -- 10.20.193.12:0/1323738097 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f39fc0416a0 con 0x7f3a08108ed0 2026-02-13T21:18:30.684 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 -- 10.20.193.12:0/423623103 wait complete. 2026-02-13T21:18:30.684 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 Processor -- start 2026-02-13T21:18:30.684 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.669+0000 7f116d6e8640 1 -- start start 2026-02-13T21:18:30.685 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f116d6e8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1168108ed0 0x7f11680eb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.685 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f116d6e8640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f116810d180 0x7f11680ebed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.685 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f116d6e8640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1168153b80 con 0x7f116810d180 2026-02-13T21:18:30.685 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f116d6e8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1168153a00 con 0x7f1168108ed0 2026-02-13T21:18:30.685 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f11667fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f116810d180 0x7f11680ebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.685 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f11667fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f116810d180 0x7f11680ebed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42588/0 (socket says 10.20.193.12:42588) 2026-02-13T21:18:30.685 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f11667fc640 1 -- 10.20.193.12:0/1498820794 learned_addr learned my addr 10.20.193.12:0/1498820794 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:30.685 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f75a3fff640 1 -- 10.20.193.12:0/948745490 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f75ac0047a0 con 0x7f75c410d180 2026-02-13T21:18:30.686 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f1166ffd640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1168108ed0 0x7f11680eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.686 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f11667fc640 1 -- 10.20.193.12:0/1498820794 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1168108ed0 msgr2=0x7f11680eb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.686 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f11667fc640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1168108ed0 0x7f11680eb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.686 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f11667fc640 1 -- 10.20.193.12:0/1498820794 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11680f11d0 con 0x7f116810d180 2026-02-13T21:18:30.686 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f11667fc640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f116810d180 0x7f11680ebed0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f115000d6a0 tx=0x7f115000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.687 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f75a3fff640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75980793f0 0x7f7598099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.687 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f75a3fff640 1 -- 10.20.193.12:0/948745490 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f75ac09cb10 con 0x7f75c410d180 2026-02-13T21:18:30.687 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f75c2ffd640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75980793f0 0x7f7598099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.688 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.670+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a08054520 con 0x7f3a08108ed0 2026-02-13T21:18:30.688 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.671+0000 7f75c2ffd640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75980793f0 0x7f7598099900 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f75b8002400 tx=0x7f75b803a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.689 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.671+0000 7f3a0c9f7640 1 -- 10.20.193.12:0/1323738097 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f39fc038470 con 0x7f3a08108ed0 2026-02-13T21:18:30.689 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.671+0000 7f3a0c9f7640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f39dc0794c0 0x7f39dc0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.689 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.671+0000 7f3a067fc640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f39dc0794c0 0x7f39dc0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.689 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.672+0000 7f3a0c9f7640 1 -- 10.20.193.12:0/1323738097 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f39fc03e070 con 0x7f3a08108ed0 2026-02-13T21:18:30.689 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.672+0000 7f3a067fc640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f39dc0794c0 0x7f39dc0999d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a0810cbd0 tx=0x7f39f0005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.689 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.673+0000 7f1147fff640 1 -- 10.20.193.12:0/1498820794 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1150014070 con 0x7f116810d180 2026-02-13T21:18:30.689 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.673+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11680f14c0 con 0x7f116810d180 2026-02-13T21:18:30.690 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.673+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11680f1ad0 con 0x7f116810d180 2026-02-13T21:18:30.690 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.673+0000 7f75a3fff640 1 -- 10.20.193.12:0/948745490 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f75ac069c30 con 0x7f75c410d180 2026-02-13T21:18:30.690 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.673+0000 7f7b04ff9640 1 -- 10.20.193.12:0/805490861 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7af806eb80 con 0x7f7b08110340 2026-02-13T21:18:30.690 INFO:teuthology.orchestra.run.trial012.stdout:141733920775 2026-02-13T21:18:30.691 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.674+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1168054520 con 0x7f116810d180 2026-02-13T21:18:30.691 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7adc079590 msgr2=0x7f7adc099aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.691 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7adc079590 0x7f7adc099aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009900 tx=0x7f7af4031040 comp rx=0 tx=0).stop 2026-02-13T21:18:30.691 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b08110340 msgr2=0x7f7b081190e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.691 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b08110340 0x7f7b081190e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7af80095a0 tx=0x7f7af800ede0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 shutdown_connections 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f7adc079590 0x7f7adc099aa0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f7b08110340 0x7f7b081190e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 --2- 10.20.193.12:0/805490861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7b0810aa00 0x7f7b08118b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 >> 10.20.193.12:0/805490861 conn(0x7f7b080e8180 msgr2=0x7f7b0810f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 shutdown_connections 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.676+0000 7f7b0ddd3640 1 -- 10.20.193.12:0/805490861 wait complete. 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.677+0000 7f1147fff640 1 -- 10.20.193.12:0/1498820794 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f115000b840 con 0x7f116810d180 2026-02-13T21:18:30.692 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.677+0000 7f1147fff640 1 -- 10.20.193.12:0/1498820794 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f115001e060 con 0x7f116810d180 2026-02-13T21:18:30.693 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.677+0000 7f3a0c9f7640 1 -- 10.20.193.12:0/1323738097 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f39fc08df60 con 0x7f3a08108ed0 2026-02-13T21:18:30.693 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f0288ed0640 1 -- 10.20.193.12:0/2154773073 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 msgr2=0x7f028410ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.693 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f0288ed0640 1 --2- 10.20.193.12:0/2154773073 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 0x7f028410ae80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0278005fd0 tx=0x7f027802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.693 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f0288ed0640 1 -- 10.20.193.12:0/2154773073 shutdown_connections 2026-02-13T21:18:30.693 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f0288ed0640 1 --2- 10.20.193.12:0/2154773073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f02841103b0 0x7f02841107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.693 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f0288ed0640 1 --2- 10.20.193.12:0/2154773073 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 0x7f028410ae80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.693 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f0288ed0640 1 -- 10.20.193.12:0/2154773073 >> 10.20.193.12:0/2154773073 conn(0x7f02840e81f0 msgr2=0x7f0284108640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.693 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f0288ed0640 1 -- 10.20.193.12:0/2154773073 shutdown_connections 2026-02-13T21:18:30.694 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f0288ed0640 1 -- 10.20.193.12:0/2154773073 wait complete. 2026-02-13T21:18:30.694 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.678+0000 7f1147fff640 1 -- 10.20.193.12:0/1498820794 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f115000b9f0 con 0x7f116810d180 2026-02-13T21:18:30.694 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f1147fff640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f113c0794c0 0x7f113c0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.694 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f1166ffd640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f113c0794c0 0x7f113c0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.694 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0288ed0640 1 Processor -- start 2026-02-13T21:18:30.695 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f1147fff640 1 -- 10.20.193.12:0/1498820794 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f115009ca10 con 0x7f116810d180 2026-02-13T21:18:30.695 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0288ed0640 1 -- start start 2026-02-13T21:18:30.695 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f1166ffd640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f113c0794c0 0x7f113c0999d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f115c005fa0 tx=0x7f115c031040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.696 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0288ed0640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 0x7f02841194f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.696 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0288ed0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f02841103b0 0x7f0284119a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.696 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0288ed0640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0284153b90 con 0x7f028410aa70 2026-02-13T21:18:30.696 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0288ed0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0284153a10 con 0x7f02841103b0 2026-02-13T21:18:30.696 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0282575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 0x7f02841194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.696 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0282575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 0x7f02841194f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42590/0 (socket says 10.20.193.12:42590) 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.679+0000 7f0282575640 1 -- 10.20.193.12:0/2763394768 learned_addr learned my addr 10.20.193.12:0/2763394768 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.680+0000 7f0281d74640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f02841103b0 0x7f0284119a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.680+0000 7f0282575640 1 -- 10.20.193.12:0/2763394768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f02841103b0 msgr2=0x7f0284119a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.680+0000 7f0282575640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f02841103b0 0x7f0284119a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.680+0000 7f0282575640 1 -- 10.20.193.12:0/2763394768 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028411ed30 con 0x7f028410aa70 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.680+0000 7f0282575640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 0x7f02841194f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f02780092e0 tx=0x7f0278002d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.681+0000 7f026b7fe640 1 -- 10.20.193.12:0/2763394768 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0278046070 con 0x7f028410aa70 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.681+0000 7f026b7fe640 1 -- 10.20.193.12:0/2763394768 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f02780044e0 con 0x7f028410aa70 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.681+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028411efc0 con 0x7f028410aa70 2026-02-13T21:18:30.697 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.681+0000 7f1147fff640 1 -- 10.20.193.12:0/1498820794 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f1150069b30 con 0x7f116810d180 2026-02-13T21:18:30.698 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.682+0000 7f026b7fe640 1 -- 10.20.193.12:0/2763394768 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0278041630 con 0x7f028410aa70 2026-02-13T21:18:30.698 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.682+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f028411f570 con 0x7f028410aa70 2026-02-13T21:18:30.698 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.682+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f028410bcf0 con 0x7f028410aa70 2026-02-13T21:18:30.698 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.682+0000 7f026b7fe640 1 -- 10.20.193.12:0/2763394768 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f0278038470 con 0x7f028410aa70 2026-02-13T21:18:30.698 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.683+0000 7f026b7fe640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f025c0791f0 0x7f025c099700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:30.699 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.683+0000 7f026b7fe640 1 -- 10.20.193.12:0/2763394768 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f027803e070 con 0x7f028410aa70 2026-02-13T21:18:30.699 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.683+0000 7f0281d74640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f025c0791f0 0x7f025c099700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:30.699 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.683+0000 7f0281d74640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f025c0791f0 0x7f025c099700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f028410e490 tx=0x7f026c0073d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:30.699 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.686+0000 7f026b7fe640 1 -- 10.20.193.12:0/2763394768 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f027808de00 con 0x7f028410aa70 2026-02-13T21:18:30.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920775 got 141733920775 for osd.5 2026-02-13T21:18:30.721 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:30.728 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.724+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcc300f9bd0 con 0x7fcc30109480 2026-02-13T21:18:30.728 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.724+0000 7fcc2cff9640 1 -- 10.20.193.12:0/1596106330 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcc1c08e400 con 0x7fcc30109480 2026-02-13T21:18:30.728 INFO:teuthology.orchestra.run.trial012.stdout:188978561027 2026-02-13T21:18:30.730 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.727+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3cac10a090 con 0x7f3cac116ba0 2026-02-13T21:18:30.731 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.727+0000 7f3c937fe640 1 -- 10.20.193.12:0/171847192 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3c94069750 con 0x7f3cac116ba0 2026-02-13T21:18:30.731 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.727+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcbfc079590 msgr2=0x7fcbfc099aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.732 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.727+0000 7fcc35c74640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcbfc079590 0x7fcbfc099aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc300e7da0 tx=0x7fcc200073d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.732 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 msgr2=0x7fcc300f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.732 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 0x7fcc300f37e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c005a20 tx=0x7fcc1c002db0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.732 INFO:teuthology.orchestra.run.trial012.stdout:103079215114 2026-02-13T21:18:30.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 shutdown_connections 2026-02-13T21:18:30.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcbfc079590 0x7fcbfc099aa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30109dd0 0x7fcc300f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 --2- 10.20.193.12:0/1596106330 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc30109480 0x7fcc300f37e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 >> 10.20.193.12:0/1596106330 conn(0x7fcc300e7010 msgr2=0x7fcc300ede00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 shutdown_connections 2026-02-13T21:18:30.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.728+0000 7fcc35c74640 1 -- 10.20.193.12:0/1596106330 wait complete. 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f3c840794c0 msgr2=0x7f3c840999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f3c840794c0 0x7f3c840999d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009900 tx=0x7f3ca0031040 comp rx=0 tx=0).stop 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac116ba0 msgr2=0x7f3cac104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac116ba0 0x7f3cac104450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005de0 tx=0x7f3c9400dd70 comp rx=0 tx=0).stop 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 shutdown_connections 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f3c840794c0 0x7f3c840999d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3cac116ba0 0x7f3cac104450 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 --2- 10.20.193.12:0/171847192 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cac05c2d0 0x7f3cac103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 >> 10.20.193.12:0/171847192 conn(0x7f3cac059bc0 msgr2=0x7f3cac05d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 shutdown_connections 2026-02-13T21:18:30.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.730+0000 7f3cb0ea6640 1 -- 10.20.193.12:0/171847192 wait complete. 2026-02-13T21:18:30.743 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.740+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff3f411efc0 con 0x7ff3f4108920 2026-02-13T21:18:30.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.740+0000 7ff3d3fff640 1 -- 10.20.193.12:0/429731188 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3e803d070 con 0x7ff3f4108920 2026-02-13T21:18:30.744 INFO:teuthology.orchestra.run.trial012.stdout:77309411340 2026-02-13T21:18:30.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff3c80794c0 msgr2=0x7ff3c80999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff3c80794c0 0x7ff3c80999d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3f410eb10 tx=0x7ff3dc005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:30.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 msgr2=0x7ff3f4118bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 0x7ff3f4118bd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800c090 tx=0x7ff3e8009440 comp rx=0 tx=0).stop 2026-02-13T21:18:30.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 shutdown_connections 2026-02-13T21:18:30.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7ff3c80794c0 0x7ff3c80999d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3f4110360 0x7ff3f4119150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 --2- 10.20.193.12:0/429731188 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7ff3f4108920 0x7ff3f4118bd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 >> 10.20.193.12:0/429731188 conn(0x7ff3f40e6340 msgr2=0x7ff3f410fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 shutdown_connections 2026-02-13T21:18:30.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.743+0000 7ff3f943a640 1 -- 10.20.193.12:0/429731188 wait complete. 2026-02-13T21:18:30.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:30 trial090 ceph-mon[42877]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:30.775 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215114 got 103079215114 for osd.3 2026-02-13T21:18:30.776 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:30.779 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561027 got 188978561027 for osd.7 2026-02-13T21:18:30.780 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:30.791 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411339 got 77309411340 for osd.2 2026-02-13T21:18:30.791 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:30.797 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.794+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3a081125d0 con 0x7f3a08108ed0 2026-02-13T21:18:30.798 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.794+0000 7f3a0c9f7640 1 -- 10.20.193.12:0/1323738097 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39fc082e20 con 0x7f3a08108ed0 2026-02-13T21:18:30.798 INFO:teuthology.orchestra.run.trial012.stdout:55834574862 2026-02-13T21:18:30.799 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.796+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f11680f1e40 con 0x7f116810d180 2026-02-13T21:18:30.800 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.796+0000 7f1147fff640 1 -- 10.20.193.12:0/1498820794 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f115006ce20 con 0x7f116810d180 2026-02-13T21:18:30.800 INFO:teuthology.orchestra.run.trial012.stdout:167503724549 2026-02-13T21:18:30.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.796+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f39dc0794c0 msgr2=0x7f39dc0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.796+0000 7f3a0d9f9640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f39dc0794c0 0x7f39dc0999d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a0810cbd0 tx=0x7f39f0005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:30.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.796+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 msgr2=0x7f3a08109eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.796+0000 7f3a0d9f9640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 0x7f3a08109eb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0092b0 tx=0x7f39fc002db0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.797+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 shutdown_connections 2026-02-13T21:18:30.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.797+0000 7f3a0d9f9640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f39dc0794c0 0x7f39dc0999d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.797+0000 7f3a0d9f9640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a0810d180 0x7f3a0810a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.797+0000 7f3a0d9f9640 1 --2- 10.20.193.12:0/1323738097 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f3a08108ed0 0x7f3a08109eb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.802 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.797+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 >> 10.20.193.12:0/1323738097 conn(0x7f3a08060840 msgr2=0x7f3a0810f970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.802 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.797+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 shutdown_connections 2026-02-13T21:18:30.802 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.797+0000 7f3a0d9f9640 1 -- 10.20.193.12:0/1323738097 wait complete. 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.798+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f113c0794c0 msgr2=0x7f113c0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.798+0000 7f116d6e8640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f113c0794c0 0x7f113c0999d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f115c005fa0 tx=0x7f115c031040 comp rx=0 tx=0).stop 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f116810d180 msgr2=0x7f11680ebed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f116810d180 0x7f11680ebed0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f115000d6a0 tx=0x7f115000db70 comp rx=0 tx=0).stop 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 shutdown_connections 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f113c0794c0 0x7f113c0999d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f116810d180 0x7f11680ebed0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 --2- 10.20.193.12:0/1498820794 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1168108ed0 0x7f11680eb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 >> 10.20.193.12:0/1498820794 conn(0x7f1168060840 msgr2=0x7f116810e530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.804 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 shutdown_connections 2026-02-13T21:18:30.804 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.799+0000 7f116d6e8640 1 -- 10.20.193.12:0/1498820794 wait complete. 2026-02-13T21:18:30.809 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.806+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f028411a650 con 0x7f028410aa70 2026-02-13T21:18:30.810 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.806+0000 7f026b7fe640 1 -- 10.20.193.12:0/2763394768 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f028411a650 con 0x7f028410aa70 2026-02-13T21:18:30.810 INFO:teuthology.orchestra.run.trial012.stdout:120259084296 2026-02-13T21:18:30.811 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.808+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f75c411f920 con 0x7f75c410d180 2026-02-13T21:18:30.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.808+0000 7f75a3fff640 1 -- 10.20.193.12:0/948745490 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f75ac06ed30 con 0x7f75c410d180 2026-02-13T21:18:30.812 INFO:teuthology.orchestra.run.trial012.stdout:38654705678 2026-02-13T21:18:30.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f025c0791f0 msgr2=0x7f025c099700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f025c0791f0 0x7f025c099700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f028410e490 tx=0x7f026c0073d0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 msgr2=0x7f02841194f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 0x7f02841194f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f02780092e0 tx=0x7f0278002d40 comp rx=0 tx=0).stop 2026-02-13T21:18:30.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 shutdown_connections 2026-02-13T21:18:30.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f025c0791f0 0x7f025c099700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f02841103b0 0x7f0284119a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 --2- 10.20.193.12:0/2763394768 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f028410aa70 0x7f02841194f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 >> 10.20.193.12:0/2763394768 conn(0x7f02840e81f0 msgr2=0x7f0284108610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 shutdown_connections 2026-02-13T21:18:30.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.810+0000 7f0288ed0640 1 -- 10.20.193.12:0/2763394768 wait complete. 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75980793f0 msgr2=0x7f7598099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75980793f0 0x7f7598099900 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f75b8002400 tx=0x7f75b803a040 comp rx=0 tx=0).stop 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c410d180 msgr2=0x7f75c4119a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c410d180 0x7f75c4119a50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0095a0 tx=0x7f75ac00ede0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 shutdown_connections 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f75980793f0 0x7f7598099900 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f75c410d180 0x7f75c4119a50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 --2- 10.20.193.12:0/948745490 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f75c4108ed0 0x7f75c41194d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:30.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 >> 10.20.193.12:0/948745490 conn(0x7f75c4060840 msgr2=0x7f75c410f970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:30.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 shutdown_connections 2026-02-13T21:18:30.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:30.811+0000 7f75c9456640 1 -- 10.20.193.12:0/948745490 wait complete. 2026-02-13T21:18:30.841 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724549 got 167503724549 for osd.6 2026-02-13T21:18:30.842 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:30.854 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084295 got 120259084296 for osd.4 2026-02-13T21:18:30.854 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:30.857 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705678 got 38654705678 for osd.0 2026-02-13T21:18:30.857 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:30.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.1 2026-02-13T21:18:30.872 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:30.872 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T21:18:30.873 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T21:18:31.030 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:31.140 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2324386062 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 msgr2=0x7f1adc152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 --2- 10.20.193.12:0/2324386062 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 0x7f1adc152cb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4005fd0 tx=0x7f1ac402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2324386062 shutdown_connections 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 --2- 10.20.193.12:0/2324386062 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 0x7f1adc152cb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 --2- 10.20.193.12:0/2324386062 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1adc1094c0 0x7f1adc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2324386062 >> 10.20.193.12:0/2324386062 conn(0x7f1adc0e7050 msgr2=0x7f1adc1074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2324386062 shutdown_connections 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2324386062 wait complete. 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 Processor -- start 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 -- start start 2026-02-13T21:18:31.141 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1adc1094c0 0x7f1adc0f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 0x7f1adc0f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc155d50 con 0x7f1adc109e10 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.135+0000 7f1ae2b01640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc155bd0 con 0x7f1adc1094c0 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 0x7f1adc0f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 0x7f1adc0f3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42612/0 (socket says 10.20.193.12:42612) 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad3fff640 1 -- 10.20.193.12:0/2086271644 learned_addr learned my addr 10.20.193.12:0/2086271644 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ae0876640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1adc1094c0 0x7f1adc0f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad3fff640 1 -- 10.20.193.12:0/2086271644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1adc1094c0 msgr2=0x7f1adc0f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad3fff640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1adc1094c0 0x7f1adc0f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad3fff640 1 -- 10.20.193.12:0/2086271644 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc0f9150 con 0x7f1adc109e10 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad3fff640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 0x7f1adc0f3e90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4002c70 tx=0x7f1ac4002ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:31.142 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad1ffb640 1 -- 10.20.193.12:0/2086271644 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1ac4046070 con 0x7f1adc109e10 2026-02-13T21:18:31.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad1ffb640 1 -- 10.20.193.12:0/2086271644 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f1ac4004420 con 0x7f1adc109e10 2026-02-13T21:18:31.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc0f93e0 con 0x7f1adc109e10 2026-02-13T21:18:31.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ad1ffb640 1 -- 10.20.193.12:0/2086271644 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1ac4041630 con 0x7f1adc109e10 2026-02-13T21:18:31.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.136+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc0f9910 con 0x7f1adc109e10 2026-02-13T21:18:31.143 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.137+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc054ab0 con 0x7f1adc109e10 2026-02-13T21:18:31.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.137+0000 7f1ad1ffb640 1 -- 10.20.193.12:0/2086271644 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f1ac4041850 con 0x7f1adc109e10 2026-02-13T21:18:31.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.138+0000 7f1ad1ffb640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1ab80793f0 0x7f1ab8099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.138+0000 7f1ad1ffb640 1 -- 10.20.193.12:0/2086271644 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f1ac403e070 con 0x7f1adc109e10 2026-02-13T21:18:31.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.138+0000 7f1ae0876640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1ab80793f0 0x7f1ab8099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.144 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.138+0000 7f1ae0876640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1ab80793f0 0x7f1ab8099900 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0fa1e0 tx=0x7f1acc009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:31.145 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.141+0000 7f1ad1ffb640 1 -- 10.20.193.12:0/2086271644 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f1ac408e280 con 0x7f1adc109e10 2026-02-13T21:18:31.251 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.247+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1adc0f9bc0 con 0x7f1ab80793f0 2026-02-13T21:18:31.252 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.248+0000 7f1ad1ffb640 1 -- 10.20.193.12:0/2086271644 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+14551 (secure 0 0 0) 0x7f1adc0f9bc0 con 0x7f1ab80793f0 2026-02-13T21:18:31.253 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:dumped all 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1ab80793f0 msgr2=0x7f1ab8099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1ab80793f0 0x7f1ab8099900 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0fa1e0 tx=0x7f1acc009260 comp rx=0 tx=0).stop 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 msgr2=0x7f1adc0f3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 0x7f1adc0f3e90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4002c70 tx=0x7f1ac4002ca0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 shutdown_connections 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f1ab80793f0 0x7f1ab8099900 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f1adc109e10 0x7f1adc0f3e90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 --2- 10.20.193.12:0/2086271644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1adc1094c0 0x7f1adc0f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.254 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 >> 10.20.193.12:0/2086271644 conn(0x7f1adc0e7050 msgr2=0x7f1adc0ede50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:31.255 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 shutdown_connections 2026-02-13T21:18:31.255 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.249+0000 7f1ae2b01640 1 -- 10.20.193.12:0/2086271644 wait complete. 2026-02-13T21:18:31.289 INFO:teuthology.orchestra.run.trial012.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2026-02-13T21:18:29.625881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5872025600,"kb_used":221068,"kb_used_data":5356,"kb_used_omap":113,"kb_used_meta":215438,"kb_avail":5871804532,"statfs":{"total":6012954214400,"available":6012727840768,"internally_reserved":0,"allocated":5484544,"data_stored":3263816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115827,"internal_metadata":220609421},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000828"},"pg_stats":[{"pgid":"1.0","version":"21'92","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-13T21:18:26.287345+0000","last_change":"2026-02-13T21:18:26.287155+0000","last_active":"2026-02-13T21:18:26.287345+0000","last_peered":"2026-02-13T21:18:26.287345+0000","last_clean":"2026-02-13T21:18:26.287345+0000","last_became_active":"2026-02-13T21:18:26.283918+0000","last_became_peered":"2026-02-13T21:18:26.283918+0000","last_unstale":"2026-02-13T21:18:26.287345+0000","last_undegraded":"2026-02-13T21:18:26.287345+0000","last_fullsized":"2026-02-13T21:18:26.287345+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T21:17:46.467876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T21:17:46.467876+0000","last_clean_scrub_stamp":"2026-02-13T21:17:46.467876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:39:45.494773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":44,"seq":188978561027,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1032,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1056768,"data_stored":776957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5514,"internal_metadata":27585142},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724549,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1032,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1056768,"data_stored":776957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920775,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084296,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9437,"internal_metadata":27581219},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13992,"internal_metadata":27576664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":27569501},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":27570803},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1032,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1056768,"data_stored":776957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25061,"internal_metadata":27565595},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T21:18:31.290 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T21:18:31.405 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:31.427 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/805490861' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T21:18:31.428 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1596106330' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T21:18:31.428 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/171847192' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T21:18:31.428 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/429731188' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T21:18:31.428 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1323738097' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T21:18:31.428 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1498820794' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T21:18:31.428 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2763394768' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T21:18:31.428 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:31 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/948745490' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T21:18:31.518 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.512+0000 7f9bf2b57640 1 -- 10.20.193.12:0/2405838165 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 msgr2=0x7f9bec152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.518 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.512+0000 7f9bf2b57640 1 --2- 10.20.193.12:0/2405838165 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 0x7f9bec152cb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009840 tx=0x7f9bd402f160 comp rx=0 tx=0).stop 2026-02-13T21:18:31.518 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.512+0000 7f9bf2b57640 1 -- 10.20.193.12:0/2405838165 shutdown_connections 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.512+0000 7f9bf2b57640 1 --2- 10.20.193.12:0/2405838165 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 0x7f9bec152cb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.512+0000 7f9bf2b57640 1 --2- 10.20.193.12:0/2405838165 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bec1094c0 0x7f9bec1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.512+0000 7f9bf2b57640 1 -- 10.20.193.12:0/2405838165 >> 10.20.193.12:0/2405838165 conn(0x7f9bec0e7050 msgr2=0x7f9bec1074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.512+0000 7f9bf2b57640 1 -- 10.20.193.12:0/2405838165 shutdown_connections 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.512+0000 7f9bf2b57640 1 -- 10.20.193.12:0/2405838165 wait complete. 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9bf2b57640 1 Processor -- start 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9bf2b57640 1 -- start start 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9bf2b57640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bec1094c0 0x7f9bec0f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9bf2b57640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 0x7f9bec0f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9bf2b57640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec155d50 con 0x7f9bec109e10 2026-02-13T21:18:31.519 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9bf2b57640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec155bd0 con 0x7f9bec1094c0 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9be3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 0x7f9bec0f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9be3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 0x7f9bec0f3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42622/0 (socket says 10.20.193.12:42622) 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9be3fff640 1 -- 10.20.193.12:0/4003598541 learned_addr learned my addr 10.20.193.12:0/4003598541 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9bf08cc640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bec1094c0 0x7f9bec0f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9be3fff640 1 -- 10.20.193.12:0/4003598541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bec1094c0 msgr2=0x7f9bec0f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9be3fff640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bec1094c0 0x7f9bec0f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9be3fff640 1 -- 10.20.193.12:0/4003598541 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec0f9150 con 0x7f9bec109e10 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9bf08cc640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bec1094c0 0x7f9bec0f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.513+0000 7f9be3fff640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 0x7f9bec0f3e90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4005a20 tx=0x7f9bd4004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.514+0000 7f9be1ffb640 1 -- 10.20.193.12:0/4003598541 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9bd4046070 con 0x7f9bec109e10 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.514+0000 7f9be1ffb640 1 -- 10.20.193.12:0/4003598541 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f9bd4002b60 con 0x7f9bec109e10 2026-02-13T21:18:31.520 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.514+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bec0f93e0 con 0x7f9bec109e10 2026-02-13T21:18:31.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.514+0000 7f9be1ffb640 1 -- 10.20.193.12:0/4003598541 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9bd4041630 con 0x7f9bec109e10 2026-02-13T21:18:31.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.514+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bec0f9910 con 0x7f9bec109e10 2026-02-13T21:18:31.521 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.514+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bec054ab0 con 0x7f9bec109e10 2026-02-13T21:18:31.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.515+0000 7f9be1ffb640 1 -- 10.20.193.12:0/4003598541 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f9bd4038990 con 0x7f9bec109e10 2026-02-13T21:18:31.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.516+0000 7f9be1ffb640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9bc80793f0 0x7f9bc8099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.516+0000 7f9bf08cc640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9bc80793f0 0x7f9bc8099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.516+0000 7f9be1ffb640 1 -- 10.20.193.12:0/4003598541 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f9bd403e070 con 0x7f9bec109e10 2026-02-13T21:18:31.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.516+0000 7f9bf08cc640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9bc80793f0 0x7f9bc8099900 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc005b60 tx=0x7f9bdc009310 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:31.522 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.518+0000 7f9be1ffb640 1 -- 10.20.193.12:0/4003598541 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f9bd4050080 con 0x7f9bec109e10 2026-02-13T21:18:31.630 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.626+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9bec0f9bc0 con 0x7f9bc80793f0 2026-02-13T21:18:31.631 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.627+0000 7f9be1ffb640 1 -- 10.20.193.12:0/4003598541 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+14551 (secure 0 0 0) 0x7f9bec0f9bc0 con 0x7f9bc80793f0 2026-02-13T21:18:31.631 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:31.632 INFO:teuthology.orchestra.run.trial012.stderr:dumped all 2026-02-13T21:18:31.632 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9bc80793f0 msgr2=0x7f9bc8099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.632 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9bc80793f0 0x7f9bc8099900 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc005b60 tx=0x7f9bdc009310 comp rx=0 tx=0).stop 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 msgr2=0x7f9bec0f3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 0x7f9bec0f3e90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4005a20 tx=0x7f9bd4004660 comp rx=0 tx=0).stop 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 shutdown_connections 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9bc80793f0 0x7f9bc8099900 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9bec109e10 0x7f9bec0f3e90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 --2- 10.20.193.12:0/4003598541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bec1094c0 0x7f9bec0f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 >> 10.20.193.12:0/4003598541 conn(0x7f9bec0e7050 msgr2=0x7f9bec0ede50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 shutdown_connections 2026-02-13T21:18:31.633 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.628+0000 7f9bf2b57640 1 -- 10.20.193.12:0/4003598541 wait complete. 2026-02-13T21:18:31.668 INFO:teuthology.orchestra.run.trial012.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-13T21:18:31.626268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5872025600,"kb_used":221068,"kb_used_data":5356,"kb_used_omap":113,"kb_used_meta":215438,"kb_avail":5871804532,"statfs":{"total":6012954214400,"available":6012727840768,"internally_reserved":0,"allocated":5484544,"data_stored":3263816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115827,"internal_metadata":220609421},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.357198"},"pg_stats":[{"pgid":"1.0","version":"21'92","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-13T21:18:26.287345+0000","last_change":"2026-02-13T21:18:26.287155+0000","last_active":"2026-02-13T21:18:26.287345+0000","last_peered":"2026-02-13T21:18:26.287345+0000","last_clean":"2026-02-13T21:18:26.287345+0000","last_became_active":"2026-02-13T21:18:26.283918+0000","last_became_peered":"2026-02-13T21:18:26.283918+0000","last_unstale":"2026-02-13T21:18:26.287345+0000","last_undegraded":"2026-02-13T21:18:26.287345+0000","last_fullsized":"2026-02-13T21:18:26.287345+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T21:17:46.467876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T21:17:46.467876+0000","last_clean_scrub_stamp":"2026-02-13T21:17:46.467876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:39:45.494773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":44,"seq":188978561028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1032,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1056768,"data_stored":776957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5514,"internal_metadata":27585142},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724550,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1032,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1056768,"data_stored":776957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920775,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084296,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9437,"internal_metadata":27581219},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215115,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13992,"internal_metadata":27576664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":27569501},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27416,"kb_used_data":452,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975784,"statfs":{"total":751619276800,"available":751591202816,"internally_reserved":0,"allocated":462848,"data_stored":186589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":27570803},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1032,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1056768,"data_stored":776957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25061,"internal_metadata":27565595},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T21:18:31.669 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T21:18:31.669 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T21:18:31.669 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T21:18:31.670 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph health --format=json 2026-02-13T21:18:31.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:31 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/805490861' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T21:18:31.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:31 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1596106330' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T21:18:31.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:31 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/171847192' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T21:18:31.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:31 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/429731188' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T21:18:31.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:31 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1323738097' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T21:18:31.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:31 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1498820794' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T21:18:31.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:31 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2763394768' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T21:18:31.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:31 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/948745490' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T21:18:31.785 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:31.905 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 -- 10.20.193.12:0/519254149 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005f1d0 msgr2=0x7fa750152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.906 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 --2- 10.20.193.12:0/519254149 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005f1d0 0x7fa750152b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa744005fd0 tx=0x7fa74402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.906 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 -- 10.20.193.12:0/519254149 shutdown_connections 2026-02-13T21:18:31.906 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 --2- 10.20.193.12:0/519254149 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005f1d0 0x7fa750152b90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.906 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 --2- 10.20.193.12:0/519254149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa75005e880 0x7fa75005ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.906 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 -- 10.20.193.12:0/519254149 >> 10.20.193.12:0/519254149 conn(0x7fa7500e8190 msgr2=0x7fa7501085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:31.907 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 -- 10.20.193.12:0/519254149 shutdown_connections 2026-02-13T21:18:31.907 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 -- 10.20.193.12:0/519254149 wait complete. 2026-02-13T21:18:31.907 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 Processor -- start 2026-02-13T21:18:31.907 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 -- start start 2026-02-13T21:18:31.907 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005e880 0x7fa7500f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.907 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa75005f1d0 0x7fa7500f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.908 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa750155de0 con 0x7fa75005e880 2026-02-13T21:18:31.908 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.900+0000 7fa758784640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa750155c60 con 0x7fa75005f1d0 2026-02-13T21:18:31.908 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7564f9640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005e880 0x7fa7500f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.908 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7564f9640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005e880 0x7fa7500f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42638/0 (socket says 10.20.193.12:42638) 2026-02-13T21:18:31.908 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7564f9640 1 -- 10.20.193.12:0/3754158403 learned_addr learned my addr 10.20.193.12:0/3754158403 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:31.908 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa755cf8640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa75005f1d0 0x7fa7500f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.909 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7564f9640 1 -- 10.20.193.12:0/3754158403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa75005f1d0 msgr2=0x7fa7500f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:31.909 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7564f9640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa75005f1d0 0x7fa7500f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:31.909 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7564f9640 1 -- 10.20.193.12:0/3754158403 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7500fb360 con 0x7fa75005e880 2026-02-13T21:18:31.909 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa755cf8640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa75005f1d0 0x7fa7500f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:31.909 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7564f9640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005e880 0x7fa7500f5b20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa74000b4a0 tx=0x7fa74000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:31.909 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7377fe640 1 -- 10.20.193.12:0/3754158403 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa740004440 con 0x7fa75005e880 2026-02-13T21:18:31.910 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7500fb650 con 0x7fa75005e880 2026-02-13T21:18:31.910 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7377fe640 1 -- 10.20.193.12:0/3754158403 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fa740015070 con 0x7fa75005e880 2026-02-13T21:18:31.910 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa7377fe640 1 -- 10.20.193.12:0/3754158403 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa740010a70 con 0x7fa75005e880 2026-02-13T21:18:31.910 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.901+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7500fbbe0 con 0x7fa75005e880 2026-02-13T21:18:31.910 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.902+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75005fd90 con 0x7fa75005e880 2026-02-13T21:18:31.912 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.902+0000 7fa7377fe640 1 -- 10.20.193.12:0/3754158403 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fa740005aa0 con 0x7fa75005e880 2026-02-13T21:18:31.912 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.903+0000 7fa7377fe640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa72c0793f0 0x7fa72c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:31.912 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.903+0000 7fa7377fe640 1 -- 10.20.193.12:0/3754158403 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fa74009c860 con 0x7fa75005e880 2026-02-13T21:18:31.912 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.903+0000 7fa755cf8640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa72c0793f0 0x7fa72c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:31.912 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.903+0000 7fa755cf8640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa72c0793f0 0x7fa72c099900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa744002400 tx=0x7fa74403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:31.913 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:31.906+0000 7fa7377fe640 1 -- 10.20.193.12:0/3754158403 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fa740069980 con 0x7fa75005e880 2026-02-13T21:18:32.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.040+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa75005ec90 con 0x7fa75005e880 2026-02-13T21:18:32.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.040+0000 7fa7377fe640 1 -- 10.20.193.12:0/3754158403 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa75005ec90 con 0x7fa75005e880 2026-02-13T21:18:32.045 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:32.045 INFO:teuthology.orchestra.run.trial012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-13T21:18:32.046 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa72c0793f0 msgr2=0x7fa72c099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.046 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa72c0793f0 0x7fa72c099900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa744002400 tx=0x7fa74403a040 comp rx=0 tx=0).stop 2026-02-13T21:18:32.046 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005e880 msgr2=0x7fa7500f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.046 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005e880 0x7fa7500f5b20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa74000b4a0 tx=0x7fa74000b970 comp rx=0 tx=0).stop 2026-02-13T21:18:32.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 shutdown_connections 2026-02-13T21:18:32.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fa72c0793f0 0x7fa72c099900 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa75005f1d0 0x7fa7500f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 --2- 10.20.193.12:0/3754158403 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fa75005e880 0x7fa7500f5b20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 >> 10.20.193.12:0/3754158403 conn(0x7fa7500e8190 msgr2=0x7fa7500f00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:32.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 shutdown_connections 2026-02-13T21:18:32.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.042+0000 7fa758784640 1 -- 10.20.193.12:0/3754158403 wait complete. 2026-02-13T21:18:32.082 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-13T21:18:32.083 INFO:tasks.cephadm:Setup complete, yielding 2026-02-13T21:18:32.083 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-13T21:18:32.091 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial012.front.sepia.ceph.com 2026-02-13T21:18:32.091 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-13T21:18:32.206 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:32.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 -- 10.20.193.12:0/2181868224 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 msgr2=0x7f97a010cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 --2- 10.20.193.12:0/2181868224 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 0x7f97a010cce0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9790005fd0 tx=0x7f979002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 -- 10.20.193.12:0/2181868224 shutdown_connections 2026-02-13T21:18:32.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 --2- 10.20.193.12:0/2181868224 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97a010d9a0 0x7f97a010ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 --2- 10.20.193.12:0/2181868224 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 0x7f97a010cce0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 -- 10.20.193.12:0/2181868224 >> 10.20.193.12:0/2181868224 conn(0x7f97a00e9f10 msgr2=0x7f97a010a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:32.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 -- 10.20.193.12:0/2181868224 shutdown_connections 2026-02-13T21:18:32.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 -- 10.20.193.12:0/2181868224 wait complete. 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 Processor -- start 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 -- start start 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 0x7f97a00f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97a010d9a0 0x7f97a00f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0151680 con 0x7f97a010c870 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.320+0000 7f97a72b3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0151500 con 0x7f97a010d9a0 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a5028640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 0x7f97a00f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a5028640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 0x7f97a00f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42656/0 (socket says 10.20.193.12:42656) 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a5028640 1 -- 10.20.193.12:0/2348032164 learned_addr learned my addr 10.20.193.12:0/2348032164 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a4827640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97a010d9a0 0x7f97a00f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a5028640 1 -- 10.20.193.12:0/2348032164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97a010d9a0 msgr2=0x7f97a00f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a5028640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97a010d9a0 0x7f97a00f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a5028640 1 -- 10.20.193.12:0/2348032164 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a00f73e0 con 0x7f97a010c870 2026-02-13T21:18:32.326 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a5028640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 0x7f97a00f6180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9790005b60 tx=0x7f9790004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:32.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f978e7fc640 1 -- 10.20.193.12:0/2348032164 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9790046070 con 0x7f97a010c870 2026-02-13T21:18:32.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a00f7670 con 0x7f97a010c870 2026-02-13T21:18:32.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f978e7fc640 1 -- 10.20.193.12:0/2348032164 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f9790038900 con 0x7f97a010c870 2026-02-13T21:18:32.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f978e7fc640 1 -- 10.20.193.12:0/2348032164 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9790041830 con 0x7f97a010c870 2026-02-13T21:18:32.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a00f7bf0 con 0x7f97a010c870 2026-02-13T21:18:32.327 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.321+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a010ddb0 con 0x7f97a010c870 2026-02-13T21:18:32.328 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.322+0000 7f978e7fc640 1 -- 10.20.193.12:0/2348032164 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f9790038470 con 0x7f97a010c870 2026-02-13T21:18:32.328 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.323+0000 7f978e7fc640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f977c0793f0 0x7f977c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:32.328 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.323+0000 7f97a4827640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f977c0793f0 0x7f977c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:32.328 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.323+0000 7f978e7fc640 1 -- 10.20.193.12:0/2348032164 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f979003e070 con 0x7f97a010c870 2026-02-13T21:18:32.328 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.323+0000 7f97a4827640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f977c0793f0 0x7f977c099900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9794004770 tx=0x7f9794005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:32.329 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.326+0000 7f978e7fc640 1 -- 10.20.193.12:0/2348032164 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f9790050080 con 0x7f97a010c870 2026-02-13T21:18:32.442 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.439+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f97a00eef60 con 0x7f977c0793f0 2026-02-13T21:18:32.443 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.440+0000 7f978e7fc640 1 -- 10.20.193.12:0/2348032164 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f97a00eef60 con 0x7f977c0793f0 2026-02-13T21:18:32.444 INFO:teuthology.orchestra.run.trial012.stdout:Backend: cephadm 2026-02-13T21:18:32.444 INFO:teuthology.orchestra.run.trial012.stdout:Available: Yes 2026-02-13T21:18:32.444 INFO:teuthology.orchestra.run.trial012.stdout:Paused: No 2026-02-13T21:18:32.445 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f977c0793f0 msgr2=0x7f977c099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.445 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f977c0793f0 0x7f977c099900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9794004770 tx=0x7f9794005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:32.445 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 msgr2=0x7f97a00f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.445 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 0x7f97a00f6180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9790005b60 tx=0x7f9790004290 comp rx=0 tx=0).stop 2026-02-13T21:18:32.445 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 shutdown_connections 2026-02-13T21:18:32.445 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f977c0793f0 0x7f977c099900 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97a010d9a0 0x7f97a00f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 --2- 10.20.193.12:0/2348032164 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f97a010c870 0x7f97a00f6180 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 >> 10.20.193.12:0/2348032164 conn(0x7f97a00e9f10 msgr2=0x7f97a00ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:32.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 shutdown_connections 2026-02-13T21:18:32.446 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.441+0000 7f97a72b3640 1 -- 10.20.193.12:0/2348032164 wait complete. 2026-02-13T21:18:32.481 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-13T21:18:32.597 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:32.620 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:32 trial012 ceph-mon[37926]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T21:18:32.620 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:32 trial012 ceph-mon[37926]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:32.621 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:32 trial012 ceph-mon[37926]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T21:18:32.621 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:32 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:18:32.621 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:32 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3754158403' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T21:18:32.712 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/961990230 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810b720 msgr2=0x7fb5e810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.712 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 --2- 10.20.193.12:0/961990230 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810b720 0x7fb5e810bb30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0005fd0 tx=0x7fb5d002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.712 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/961990230 shutdown_connections 2026-02-13T21:18:32.712 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 --2- 10.20.193.12:0/961990230 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810b720 0x7fb5e810bb30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.712 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 --2- 10.20.193.12:0/961990230 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e810a5f0 0x7fb5e810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.712 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/961990230 >> 10.20.193.12:0/961990230 conn(0x7fb5e80e7c90 msgr2=0x7fb5e8108140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:32.712 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/961990230 shutdown_connections 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/961990230 wait complete. 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 Processor -- start 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 -- start start 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810a5f0 0x7fb5e80f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e810b720 0x7fb5e80f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e814f410 con 0x7fb5e810a5f0 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.707+0000 7fb5ed7fe640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e814f290 con 0x7fb5e810b720 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5e6ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810a5f0 0x7fb5e80f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5e6ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810a5f0 0x7fb5e80f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42668/0 (socket says 10.20.193.12:42668) 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5e6ffd640 1 -- 10.20.193.12:0/1905196434 learned_addr learned my addr 10.20.193.12:0/1905196434 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5e67fc640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e810b720 0x7fb5e80f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5e6ffd640 1 -- 10.20.193.12:0/1905196434 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e810b720 msgr2=0x7fb5e80f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5e6ffd640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e810b720 0x7fb5e80f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.713 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5e6ffd640 1 -- 10.20.193.12:0/1905196434 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e80f51c0 con 0x7fb5e810a5f0 2026-02-13T21:18:32.714 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5e6ffd640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810a5f0 0x7fb5e80f3f60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0094b0 tx=0x7fb5dc00ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:32.714 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5c7fff640 1 -- 10.20.193.12:0/1905196434 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb5dc00cac0 con 0x7fb5e810a5f0 2026-02-13T21:18:32.714 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5c7fff640 1 -- 10.20.193.12:0/1905196434 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fb5dc004d10 con 0x7fb5e810a5f0 2026-02-13T21:18:32.714 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e80f54b0 con 0x7fb5e810a5f0 2026-02-13T21:18:32.714 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5c7fff640 1 -- 10.20.193.12:0/1905196434 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb5dc005720 con 0x7fb5e810a5f0 2026-02-13T21:18:32.714 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e80f5ac0 con 0x7fb5e810a5f0 2026-02-13T21:18:32.714 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.708+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e810aa60 con 0x7fb5e810a5f0 2026-02-13T21:18:32.715 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.709+0000 7fb5c7fff640 1 -- 10.20.193.12:0/1905196434 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fb5dc0047a0 con 0x7fb5e810a5f0 2026-02-13T21:18:32.715 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.710+0000 7fb5c7fff640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb5bc079570 0x7fb5bc099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:32.715 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.710+0000 7fb5e67fc640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb5bc079570 0x7fb5bc099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:32.715 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.710+0000 7fb5c7fff640 1 -- 10.20.193.12:0/1905196434 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fb5dc09cbd0 con 0x7fb5e810a5f0 2026-02-13T21:18:32.715 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.710+0000 7fb5e67fc640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb5bc079570 0x7fb5bc099a80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0002400 tx=0x7fb5d003a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:32.716 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.713+0000 7fb5c7fff640 1 -- 10.20.193.12:0/1905196434 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fb5dc069cf0 con 0x7fb5e810a5f0 2026-02-13T21:18:32.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:32 trial090 ceph-mon[42877]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T21:18:32.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:32 trial090 ceph-mon[42877]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:32.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:32 trial090 ceph-mon[42877]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T21:18:32.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:32 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:18:32.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:32 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3754158403' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T21:18:32.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.823+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb5e80ed090 con 0x7fb5bc079570 2026-02-13T21:18:32.831 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.828+0000 7fb5c7fff640 1 -- 10.20.193.12:0/1905196434 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3388 (secure 0 0 0) 0x7fb5e80ed090 con 0x7fb5bc079570 2026-02-13T21:18:32.832 INFO:teuthology.orchestra.run.trial012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-13T21:18:32.832 INFO:teuthology.orchestra.run.trial012.stdout:alertmanager.trial012 trial012 *:9093,9094 running (76s) 18s ago 102s 20.2M - 0.28.1 91c01b3cec9b ebf519da5ffb 2026-02-13T21:18:32.832 INFO:teuthology.orchestra.run.trial012.stdout:ceph-exporter.trial012 trial012 *:9926 running (106s) 18s ago 106s 76.4M - 20.2.0-690-g3baf6bae c6f9d1e4efcb 0aa9061d3f66 2026-02-13T21:18:32.832 INFO:teuthology.orchestra.run.trial012.stdout:ceph-exporter.trial090 trial090 *:9926 running (87s) 9s ago 87s 76.5M - 20.2.0-690-g3baf6bae c6f9d1e4efcb 2d6b09d02a4e 2026-02-13T21:18:32.832 INFO:teuthology.orchestra.run.trial012.stdout:crash.trial012 trial012 running (105s) 18s ago 105s 7638k - 20.2.0-690-g3baf6bae c6f9d1e4efcb 13764d6ba306 2026-02-13T21:18:32.832 INFO:teuthology.orchestra.run.trial012.stdout:crash.trial090 trial090 running (87s) 9s ago 87s 7629k - 20.2.0-690-g3baf6bae c6f9d1e4efcb b4b4c4bed590 2026-02-13T21:18:32.832 INFO:teuthology.orchestra.run.trial012.stdout:grafana.trial012 trial012 *:3000 running (75s) 18s ago 97s 118M - 12.3.1 5cdab57891ea 02a60e0fc494 2026-02-13T21:18:32.832 INFO:teuthology.orchestra.run.trial012.stdout:mgr.trial012.zqhrrq trial012 *:9283,8765,8443 running (2m) 18s ago 2m 623M - 20.2.0-690-g3baf6bae c6f9d1e4efcb e4b60e5731c6 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:mgr.trial090.qsdrej trial090 *:8443,9283,8765 running (85s) 9s ago 85s 559M - 20.2.0-690-g3baf6bae c6f9d1e4efcb 1da434fb4499 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:mon.trial012 trial012 running (2m) 18s ago 2m 121M 2048M 20.2.0-690-g3baf6bae c6f9d1e4efcb ee692368d751 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:mon.trial090 trial090 running (84s) 9s ago 84s 108M 2048M 20.2.0-690-g3baf6bae c6f9d1e4efcb 2e254abd16b2 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:node-exporter.trial012 trial012 *:9100 running (104s) 18s ago 104s 14.4M - 1.9.1 255ec253085f 6d162bf7a646 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:node-exporter.trial090 trial090 *:9100 running (85s) 9s ago 85s 10.8M - 1.9.1 255ec253085f 974efab8b91e 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:osd.0 trial012 running (66s) 18s ago 68s 112M 19.2G 20.2.0-690-g3baf6bae c6f9d1e4efcb 3bf78fc44442 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:osd.1 trial012 running (59s) 18s ago 59s 111M 19.2G 20.2.0-690-g3baf6bae c6f9d1e4efcb 17be252787f8 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:osd.2 trial012 running (52s) 18s ago 52s 111M 19.2G 20.2.0-690-g3baf6bae c6f9d1e4efcb ba65e7371d79 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:osd.3 trial012 running (45s) 18s ago 45s 101M 19.2G 20.2.0-690-g3baf6bae c6f9d1e4efcb 54216cd373d6 2026-02-13T21:18:32.833 INFO:teuthology.orchestra.run.trial012.stdout:osd.4 trial090 running (36s) 9s ago 38s 106M 19.9G 20.2.0-690-g3baf6bae c6f9d1e4efcb 0d3fef1e2c01 2026-02-13T21:18:32.834 INFO:teuthology.orchestra.run.trial012.stdout:osd.5 trial090 running (27s) 9s ago 29s 106M 19.9G 20.2.0-690-g3baf6bae c6f9d1e4efcb 9f8f63d55fd5 2026-02-13T21:18:32.834 INFO:teuthology.orchestra.run.trial012.stdout:osd.6 trial090 running (20s) 9s ago 20s 104M 19.9G 20.2.0-690-g3baf6bae c6f9d1e4efcb 2ed096c9c4ee 2026-02-13T21:18:32.834 INFO:teuthology.orchestra.run.trial012.stdout:osd.7 trial090 running (11s) 9s ago 13s 95.1M 19.9G 20.2.0-690-g3baf6bae c6f9d1e4efcb 82df21c7c5f6 2026-02-13T21:18:32.834 INFO:teuthology.orchestra.run.trial012.stdout:prometheus.trial012 trial012 *:9095 running (74s) 18s ago 95s 42.8M - 3.6.0 4fcecf061b74 c7657425843c 2026-02-13T21:18:32.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb5bc079570 msgr2=0x7fb5bc099a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb5bc079570 0x7fb5bc099a80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0002400 tx=0x7fb5d003a040 comp rx=0 tx=0).stop 2026-02-13T21:18:32.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810a5f0 msgr2=0x7fb5e80f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:32.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810a5f0 0x7fb5e80f3f60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0094b0 tx=0x7fb5dc00ede0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 shutdown_connections 2026-02-13T21:18:32.836 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fb5bc079570 0x7fb5bc099a80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.836 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e810b720 0x7fb5e80f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.836 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 --2- 10.20.193.12:0/1905196434 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fb5e810a5f0 0x7fb5e80f3f60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:32.836 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 >> 10.20.193.12:0/1905196434 conn(0x7fb5e80e7c90 msgr2=0x7fb5e80ea240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:32.836 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 shutdown_connections 2026-02-13T21:18:32.836 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:32.829+0000 7fb5ed7fe640 1 -- 10.20.193.12:0/1905196434 wait complete. 2026-02-13T21:18:32.872 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-13T21:18:32.990 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:33.101 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 -- 10.20.193.12:0/842611518 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 msgr2=0x7f4c7810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.101 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 --2- 10.20.193.12:0/842611518 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 0x7f4c7810bb30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4c68005fd0 tx=0x7f4c6802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 -- 10.20.193.12:0/842611518 shutdown_connections 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 --2- 10.20.193.12:0/842611518 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 0x7f4c7810bb30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 --2- 10.20.193.12:0/842611518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7810a5f0 0x7f4c7810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 -- 10.20.193.12:0/842611518 >> 10.20.193.12:0/842611518 conn(0x7f4c780e7c90 msgr2=0x7f4c78108140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 -- 10.20.193.12:0/842611518 shutdown_connections 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 -- 10.20.193.12:0/842611518 wait complete. 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 Processor -- start 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 -- start start 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7810a5f0 0x7f4c780f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.102 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 0x7f4c780f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7814f410 con 0x7f4c7810b720 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c7e304640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7814f290 con 0x7f4c7810a5f0 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c777fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 0x7f4c780f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c777fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 0x7f4c780f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42690/0 (socket says 10.20.193.12:42690) 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c777fe640 1 -- 10.20.193.12:0/1547835037 learned_addr learned my addr 10.20.193.12:0/1547835037 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.096+0000 7f4c77fff640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7810a5f0 0x7f4c780f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c777fe640 1 -- 10.20.193.12:0/1547835037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7810a5f0 msgr2=0x7f4c780f3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c777fe640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7810a5f0 0x7f4c780f3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c777fe640 1 -- 10.20.193.12:0/1547835037 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c780f5180 con 0x7f4c7810b720 2026-02-13T21:18:33.103 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c777fe640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 0x7f4c780f4590 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c68005a20 tx=0x7f4c68004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:33.104 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c757fa640 1 -- 10.20.193.12:0/1547835037 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4c68046070 con 0x7f4c7810b720 2026-02-13T21:18:33.104 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c757fa640 1 -- 10.20.193.12:0/1547835037 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f4c68038900 con 0x7f4c7810b720 2026-02-13T21:18:33.104 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c757fa640 1 -- 10.20.193.12:0/1547835037 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4c68041750 con 0x7f4c7810b720 2026-02-13T21:18:33.104 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c780f5410 con 0x7f4c7810b720 2026-02-13T21:18:33.104 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c780f59c0 con 0x7f4c7810b720 2026-02-13T21:18:33.104 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.097+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7810aa60 con 0x7f4c7810b720 2026-02-13T21:18:33.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.098+0000 7f4c757fa640 1 -- 10.20.193.12:0/1547835037 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f4c68038470 con 0x7f4c7810b720 2026-02-13T21:18:33.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.099+0000 7f4c757fa640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4c4c0794c0 0x7f4c4c0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.099+0000 7f4c77fff640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4c4c0794c0 0x7f4c4c0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:33.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.099+0000 7f4c757fa640 1 -- 10.20.193.12:0/1547835037 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f4c6803e070 con 0x7f4c7810b720 2026-02-13T21:18:33.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.099+0000 7f4c77fff640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4c4c0794c0 0x7f4c4c0999d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4c64004770 tx=0x7f4c64009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:33.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.101+0000 7f4c757fa640 1 -- 10.20.193.12:0/1547835037 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f4c68050080 con 0x7f4c7810b720 2026-02-13T21:18:33.215 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.212+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f4c780ea8d0 con 0x7f4c4c0794c0 2026-02-13T21:18:33.218 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.215+0000 7f4c757fa640 1 -- 10.20.193.12:0/1547835037 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1260 (secure 0 0 0) 0x7f4c780ea8d0 con 0x7f4c4c0794c0 2026-02-13T21:18:33.218 INFO:teuthology.orchestra.run.trial012.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:alertmanager ?:9093,9094 1/1 18s ago 116s count:1 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:ceph-exporter ?:9926 2/2 18s ago 117s * 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:crash 2/2 18s ago 117s * 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:grafana ?:3000 1/1 18s ago 116s count:1 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:mgr 2/2 18s ago 117s count:2 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:mon 2/2 18s ago 103s trial012:10.20.193.12=trial012;trial090:10.20.193.90=trial090;count:2 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:node-exporter ?:9100 2/2 18s ago 116s * 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:osd.default 8 18s ago 18s trial090 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stdout:prometheus ?:9095 1/1 18s ago 117s count:1 2026-02-13T21:18:33.219 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4c4c0794c0 msgr2=0x7f4c4c0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4c4c0794c0 0x7f4c4c0999d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4c64004770 tx=0x7f4c64009260 comp rx=0 tx=0).stop 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 msgr2=0x7f4c780f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 0x7f4c780f4590 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c68005a20 tx=0x7f4c68004290 comp rx=0 tx=0).stop 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 shutdown_connections 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f4c4c0794c0 0x7f4c4c0999d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f4c7810b720 0x7f4c780f4590 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 --2- 10.20.193.12:0/1547835037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7810a5f0 0x7f4c780f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 >> 10.20.193.12:0/1547835037 conn(0x7f4c780e7c90 msgr2=0x7f4c780ea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 shutdown_connections 2026-02-13T21:18:33.220 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.216+0000 7f4c7e304640 1 -- 10.20.193.12:0/1547835037 wait complete. 2026-02-13T21:18:33.260 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-13T21:18:33.377 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:33.492 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:33 trial012 ceph-mon[37926]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:33.492 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:33 trial012 ceph-mon[37926]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:33.495 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.490+0000 7fe977780640 1 -- 10.20.193.12:0/3754157899 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe970108980 msgr2=0x7fe970108d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.495 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.490+0000 7fe977780640 1 --2- 10.20.193.12:0/3754157899 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe970108980 0x7fe970108d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe960005fd0 tx=0x7fe96002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.490+0000 7fe977780640 1 -- 10.20.193.12:0/3754157899 shutdown_connections 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.490+0000 7fe977780640 1 --2- 10.20.193.12:0/3754157899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9701093b0 0x7fe97014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.490+0000 7fe977780640 1 --2- 10.20.193.12:0/3754157899 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe970108980 0x7fe970108d90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.490+0000 7fe977780640 1 -- 10.20.193.12:0/3754157899 >> 10.20.193.12:0/3754157899 conn(0x7fe9700e62a0 msgr2=0x7fe970106750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.490+0000 7fe977780640 1 -- 10.20.193.12:0/3754157899 shutdown_connections 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.490+0000 7fe977780640 1 -- 10.20.193.12:0/3754157899 wait complete. 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe977780640 1 Processor -- start 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe977780640 1 -- start start 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe977780640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe970108980 0x7fe970106750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.496 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe977780640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe9701093b0 0x7fe970117a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe977780640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe97014f3e0 con 0x7fe9701093b0 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe977780640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe97014f260 con 0x7fe970108980 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe974cf4640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe9701093b0 0x7fe970117a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe974cf4640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe9701093b0 0x7fe970117a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42720/0 (socket says 10.20.193.12:42720) 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe974cf4640 1 -- 10.20.193.12:0/1718161804 learned_addr learned my addr 10.20.193.12:0/1718161804 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe974cf4640 1 -- 10.20.193.12:0/1718161804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe970108980 msgr2=0x7fe970106750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe974cf4640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe970108980 0x7fe970106750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe974cf4640 1 -- 10.20.193.12:0/1718161804 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9701180d0 con 0x7fe9701093b0 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe974cf4640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe9701093b0 0x7fe970117a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9640094b0 tx=0x7fe96400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe95e7fc640 1 -- 10.20.193.12:0/1718161804 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe96400cac0 con 0x7fe9701093b0 2026-02-13T21:18:33.497 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9701183c0 con 0x7fe9701093b0 2026-02-13T21:18:33.498 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe95e7fc640 1 -- 10.20.193.12:0/1718161804 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fe964004d10 con 0x7fe9701093b0 2026-02-13T21:18:33.498 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe95e7fc640 1 -- 10.20.193.12:0/1718161804 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe964005720 con 0x7fe9701093b0 2026-02-13T21:18:33.498 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.491+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe970118e30 con 0x7fe9701093b0 2026-02-13T21:18:33.498 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.492+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe970108d90 con 0x7fe9701093b0 2026-02-13T21:18:33.499 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.493+0000 7fe95e7fc640 1 -- 10.20.193.12:0/1718161804 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fe9640047a0 con 0x7fe9701093b0 2026-02-13T21:18:33.499 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.493+0000 7fe95e7fc640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe94c079570 0x7fe94c099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.499 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.493+0000 7fe95e7fc640 1 -- 10.20.193.12:0/1718161804 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7fe96409cbd0 con 0x7fe9701093b0 2026-02-13T21:18:33.499 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.493+0000 7fe9754f5640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe94c079570 0x7fe94c099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:33.499 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.493+0000 7fe9754f5640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe94c079570 0x7fe94c099a80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe960005fd0 tx=0x7fe960005930 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:33.500 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.496+0000 7fe95e7fc640 1 -- 10.20.193.12:0/1718161804 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fe964069cf0 con 0x7fe9701093b0 2026-02-13T21:18:33.611 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.608+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fe970111090 con 0x7fe94c079570 2026-02-13T21:18:33.612 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.609+0000 7fe95e7fc640 1 -- 10.20.193.12:0/1718161804 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+142 (secure 0 0 0) 0x7fe970111090 con 0x7fe94c079570 2026-02-13T21:18:33.613 INFO:teuthology.orchestra.run.trial012.stdout:HOST ADDR LABELS STATUS 2026-02-13T21:18:33.613 INFO:teuthology.orchestra.run.trial012.stdout:trial012 10.20.193.12 2026-02-13T21:18:33.613 INFO:teuthology.orchestra.run.trial012.stdout:trial090 10.20.193.90 2026-02-13T21:18:33.613 INFO:teuthology.orchestra.run.trial012.stdout:2 hosts in cluster 2026-02-13T21:18:33.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe94c079570 msgr2=0x7fe94c099a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe94c079570 0x7fe94c099a80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe960005fd0 tx=0x7fe960005930 comp rx=0 tx=0).stop 2026-02-13T21:18:33.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe9701093b0 msgr2=0x7fe970117a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe9701093b0 0x7fe970117a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9640094b0 tx=0x7fe96400ede0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 shutdown_connections 2026-02-13T21:18:33.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fe94c079570 0x7fe94c099a80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fe9701093b0 0x7fe970117a00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 --2- 10.20.193.12:0/1718161804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe970108980 0x7fe970106750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 >> 10.20.193.12:0/1718161804 conn(0x7fe9700e62a0 msgr2=0x7fe97010e280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:33.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 shutdown_connections 2026-02-13T21:18:33.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.610+0000 7fe977780640 1 -- 10.20.193.12:0/1718161804 wait complete. 2026-02-13T21:18:33.652 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-13T21:18:33.769 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:33.771 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:33 trial090 ceph-mon[42877]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:33.771 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:33 trial090 ceph-mon[42877]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:33.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 -- 10.20.193.12:0/1596512160 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 msgr2=0x7f052410a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 --2- 10.20.193.12:0/1596512160 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 0x7f052410a9f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0514005fd0 tx=0x7f051402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 -- 10.20.193.12:0/1596512160 shutdown_connections 2026-02-13T21:18:33.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 --2- 10.20.193.12:0/1596512160 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 0x7f052410a9f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 --2- 10.20.193.12:0/1596512160 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05241094b0 0x7f0524109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 -- 10.20.193.12:0/1596512160 >> 10.20.193.12:0/1596512160 conn(0x7f05240e6b50 msgr2=0x7f0524107000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:33.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 -- 10.20.193.12:0/1596512160 shutdown_connections 2026-02-13T21:18:33.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 -- 10.20.193.12:0/1596512160 wait complete. 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 Processor -- start 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 -- start start 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05241094b0 0x7f05240ea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 0x7f05240e9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f052414e2d0 con 0x7f052410a5e0 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0529cc9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f052414e150 con 0x7f05241094b0 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0522ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 0x7f05240e9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0522ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 0x7f05240e9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42736/0 (socket says 10.20.193.12:42736) 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f0522ffd640 1 -- 10.20.193.12:0/1146493842 learned_addr learned my addr 10.20.193.12:0/1146493842 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.885+0000 7f05237fe640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05241094b0 0x7f05240ea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0522ffd640 1 -- 10.20.193.12:0/1146493842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05241094b0 msgr2=0x7f05240ea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0522ffd640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05241094b0 0x7f05240ea9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0522ffd640 1 -- 10.20.193.12:0/1146493842 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05240eb260 con 0x7f052410a5e0 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0522ffd640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 0x7f05240e9260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0514005a20 tx=0x7f0514004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:33.891 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0520ff9640 1 -- 10.20.193.12:0/1146493842 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0514046070 con 0x7f052410a5e0 2026-02-13T21:18:33.892 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0520ff9640 1 -- 10.20.193.12:0/1146493842 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f0514038900 con 0x7f052410a5e0 2026-02-13T21:18:33.892 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05240e97a0 con 0x7f052410a5e0 2026-02-13T21:18:33.892 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0520ff9640 1 -- 10.20.193.12:0/1146493842 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0514041730 con 0x7f052410a5e0 2026-02-13T21:18:33.892 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05240e9d50 con 0x7f052410a5e0 2026-02-13T21:18:33.892 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.886+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052414eab0 con 0x7f052410a5e0 2026-02-13T21:18:33.892 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.887+0000 7f0520ff9640 1 -- 10.20.193.12:0/1146493842 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f0514038470 con 0x7f052410a5e0 2026-02-13T21:18:33.893 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.887+0000 7f0520ff9640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04f80793f0 0x7f04f8099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:33.893 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.888+0000 7f0520ff9640 1 -- 10.20.193.12:0/1146493842 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f051403e070 con 0x7f052410a5e0 2026-02-13T21:18:33.893 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.888+0000 7f05237fe640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04f80793f0 0x7f04f8099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:33.893 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.888+0000 7f05237fe640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04f80793f0 0x7f04f8099900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0510004770 tx=0x7f0510005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:33.894 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:33.890+0000 7f0520ff9640 1 -- 10.20.193.12:0/1146493842 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f0514050080 con 0x7f052410a5e0 2026-02-13T21:18:34.004 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.001+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f0524054f60 con 0x7f04f80793f0 2026-02-13T21:18:34.006 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.002+0000 7f0520ff9640 1 -- 10.20.193.12:0/1146493842 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+650 (secure 0 0 0) 0x7f0524054f60 con 0x7f04f80793f0 2026-02-13T21:18:34.006 INFO:teuthology.orchestra.run.trial012.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-13T21:18:34.006 INFO:teuthology.orchestra.run.trial012.stdout:trial012 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47DD8 1788G No 34s ago Has a FileSystem, LVM detected 2026-02-13T21:18:34.006 INFO:teuthology.orchestra.run.trial012.stdout:trial012 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B0023B 1788G No 34s ago Has a FileSystem, LVM detected 2026-02-13T21:18:34.006 INFO:teuthology.orchestra.run.trial012.stdout:trial090 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B0029E 1788G No 10s ago Has a FileSystem, LVM detected 2026-02-13T21:18:34.006 INFO:teuthology.orchestra.run.trial012.stdout:trial090 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00140 1788G No 10s ago Has a FileSystem, LVM detected 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04f80793f0 msgr2=0x7f04f8099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04f80793f0 0x7f04f8099900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0510004770 tx=0x7f0510005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 msgr2=0x7f05240e9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 0x7f05240e9260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0514005a20 tx=0x7f0514004290 comp rx=0 tx=0).stop 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 shutdown_connections 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04f80793f0 0x7f04f8099900 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f052410a5e0 0x7f05240e9260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 --2- 10.20.193.12:0/1146493842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05241094b0 0x7f05240ea9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 >> 10.20.193.12:0/1146493842 conn(0x7f05240e6b50 msgr2=0x7f0524054850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:34.008 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 shutdown_connections 2026-02-13T21:18:34.009 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.003+0000 7f0529cc9640 1 -- 10.20.193.12:0/1146493842 wait complete. 2026-02-13T21:18:34.047 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-13T21:18:34.060 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial012.front.sepia.ceph.com 2026-02-13T21:18:34.060 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph fs volume create foo' 2026-02-13T21:18:34.178 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:34.298 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.293+0000 7f555c008640 1 -- 10.20.193.12:0/2326380211 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 msgr2=0x7f555414bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.293+0000 7f555c008640 1 --2- 10.20.193.12:0/2326380211 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 0x7f555414bc80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5548005fd0 tx=0x7f554802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.293+0000 7f555c008640 1 -- 10.20.193.12:0/2326380211 shutdown_connections 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.293+0000 7f555c008640 1 --2- 10.20.193.12:0/2326380211 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 0x7f555414bc80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.293+0000 7f555c008640 1 --2- 10.20.193.12:0/2326380211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5554054f70 0x7f555412b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.293+0000 7f555c008640 1 -- 10.20.193.12:0/2326380211 >> 10.20.193.12:0/2326380211 conn(0x7f55540e6b50 msgr2=0x7f5554107000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.293+0000 7f555c008640 1 -- 10.20.193.12:0/2326380211 shutdown_connections 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.293+0000 7f555c008640 1 -- 10.20.193.12:0/2326380211 wait complete. 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555c008640 1 Processor -- start 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555c008640 1 -- start start 2026-02-13T21:18:34.299 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555c008640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5554054f70 0x7f5554107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:34.300 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555c008640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 0x7f5554117650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:34.300 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555c008640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f555414f400 con 0x7f555412b840 2026-02-13T21:18:34.300 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555c008640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f555414f280 con 0x7f5554054f70 2026-02-13T21:18:34.300 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555957c640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 0x7f5554117650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:34.300 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555957c640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 0x7f5554117650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42754/0 (socket says 10.20.193.12:42754) 2026-02-13T21:18:34.300 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555957c640 1 -- 10.20.193.12:0/1222231386 learned_addr learned my addr 10.20.193.12:0/1222231386 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:34.300 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f5559d7d640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5554054f70 0x7f5554107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:34.300 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555957c640 1 -- 10.20.193.12:0/1222231386 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5554054f70 msgr2=0x7f5554107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:34.301 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555957c640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5554054f70 0x7f5554107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:34.301 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555957c640 1 -- 10.20.193.12:0/1222231386 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5554117d20 con 0x7f555412b840 2026-02-13T21:18:34.301 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.294+0000 7f555957c640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 0x7f5554117650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5548005a20 tx=0x7f5548004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:34.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.296+0000 7f5542ffd640 1 -- 10.20.193.12:0/1222231386 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5548046070 con 0x7f555412b840 2026-02-13T21:18:34.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.296+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5554117fb0 con 0x7f555412b840 2026-02-13T21:18:34.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.296+0000 7f5542ffd640 1 -- 10.20.193.12:0/1222231386 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f5548038900 con 0x7f555412b840 2026-02-13T21:18:34.302 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.296+0000 7f5542ffd640 1 -- 10.20.193.12:0/1222231386 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5548041750 con 0x7f555412b840 2026-02-13T21:18:34.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.296+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5554118a80 con 0x7f555412b840 2026-02-13T21:18:34.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.296+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55541194f0 con 0x7f555412b840 2026-02-13T21:18:34.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.297+0000 7f5542ffd640 1 -- 10.20.193.12:0/1222231386 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f5548038470 con 0x7f555412b840 2026-02-13T21:18:34.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.297+0000 7f5542ffd640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f55300793f0 0x7f5530099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:34.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.298+0000 7f5559d7d640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f55300793f0 0x7f5530099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:34.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.298+0000 7f5542ffd640 1 -- 10.20.193.12:0/1222231386 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5496+0+0 (secure 0 0 0) 0x7f554803e070 con 0x7f555412b840 2026-02-13T21:18:34.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.298+0000 7f5559d7d640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f55300793f0 0x7f5530099900 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5544004770 tx=0x7f5544009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:34.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.302+0000 7f5542ffd640 1 -- 10.20.193.12:0/1222231386 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f554808e080 con 0x7f555412b840 2026-02-13T21:18:34.429 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:34.425+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}) -- 0x7f55541109c0 con 0x7f55300793f0 2026-02-13T21:18:34.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:34 trial012 ceph-mon[37926]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:34.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:34 trial012 ceph-mon[37926]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:34.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:34 trial012 ceph-mon[37926]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 69 KiB/s, 0 objects/s recovering 2026-02-13T21:18:34.771 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:34 trial090 ceph-mon[42877]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:34.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:34 trial090 ceph-mon[42877]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:34.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:34 trial090 ceph-mon[42877]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 69 KiB/s, 0 objects/s recovering 2026-02-13T21:18:35.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:35 trial012 ceph-mon[37926]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:35.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:35 trial012 ceph-mon[37926]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:35.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:35 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool create", "pool": "cephfs.foo.meta"} : dispatch 2026-02-13T21:18:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:35 trial090 ceph-mon[42877]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:35 trial090 ceph-mon[42877]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:35.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:35 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool create", "pool": "cephfs.foo.meta"} : dispatch 2026-02-13T21:18:36.321 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.317+0000 7f5542ffd640 1 -- 10.20.193.12:0/1222231386 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f55541109c0 con 0x7f55300793f0 2026-02-13T21:18:36.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f55300793f0 msgr2=0x7f5530099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:36.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f55300793f0 0x7f5530099900 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5544004770 tx=0x7f5544009260 comp rx=0 tx=0).stop 2026-02-13T21:18:36.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 msgr2=0x7f5554117650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:36.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 0x7f5554117650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5548005a20 tx=0x7f5548004290 comp rx=0 tx=0).stop 2026-02-13T21:18:36.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 shutdown_connections 2026-02-13T21:18:36.324 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f55300793f0 0x7f5530099900 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f555412b840 0x7f5554117650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 --2- 10.20.193.12:0/1222231386 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5554054f70 0x7f5554107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 >> 10.20.193.12:0/1222231386 conn(0x7f55540e6b50 msgr2=0x7f555410de60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:36.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 shutdown_connections 2026-02-13T21:18:36.325 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.320+0000 7f555c008640 1 -- 10.20.193.12:0/1222231386 wait complete. 2026-02-13T21:18:36.363 INFO:teuthology.run_tasks:Running task fs.ready... 2026-02-13T21:18:36.378 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T21:18:36.494 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:36.582 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2026-02-13T21:18:36.582 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:36 trial090 ceph-mon[42877]: osdmap e47: 8 total, 8 up, 8 in 2026-02-13T21:18:36.582 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:36 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"} : dispatch 2026-02-13T21:18:36.582 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:36 trial090 ceph-mon[42877]: pgmap v82: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 62 KiB/s, 0 objects/s recovering 2026-02-13T21:18:36.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 -- 10.20.193.12:0/1648818627 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 msgr2=0x7f6a501091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:36.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 --2- 10.20.193.12:0/1648818627 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 0x7f6a501091c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005fd0 tx=0x7f6a4002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 -- 10.20.193.12:0/1648818627 shutdown_connections 2026-02-13T21:18:36.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 --2- 10.20.193.12:0/1648818627 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6a50109700 0x7f6a5010d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 --2- 10.20.193.12:0/1648818627 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 0x7f6a501091c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 -- 10.20.193.12:0/1648818627 >> 10.20.193.12:0/1648818627 conn(0x7f6a50062ae0 msgr2=0x7f6a50062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:36.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 -- 10.20.193.12:0/1648818627 shutdown_connections 2026-02-13T21:18:36.610 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 -- 10.20.193.12:0/1648818627 wait complete. 2026-02-13T21:18:36.611 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2026-02-13T21:18:36.611 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:36 trial012 ceph-mon[37926]: osdmap e47: 8 total, 8 up, 8 in 2026-02-13T21:18:36.611 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:36 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"} : dispatch 2026-02-13T21:18:36.611 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:36 trial012 ceph-mon[37926]: pgmap v82: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 62 KiB/s, 0 objects/s recovering 2026-02-13T21:18:36.611 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:36 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012[37922]: 2026-02-13T21:18:36.308+0000 7efd402bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:36.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 Processor -- start 2026-02-13T21:18:36.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.606+0000 7f6a57306640 1 -- start start 2026-02-13T21:18:36.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a57306640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 0x7f6a501204f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:36.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a57306640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6a50109700 0x7f6a50120a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:36.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a57306640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5015a2b0 con 0x7f6a50108db0 2026-02-13T21:18:36.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a57306640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5015a130 con 0x7f6a50109700 2026-02-13T21:18:36.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a5507b640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 0x7f6a501204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:36.614 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a5507b640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 0x7f6a501204f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42776/0 (socket says 10.20.193.12:42776) 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a5507b640 1 -- 10.20.193.12:0/3353139983 learned_addr learned my addr 10.20.193.12:0/3353139983 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a5507b640 1 -- 10.20.193.12:0/3353139983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6a50109700 msgr2=0x7f6a50120a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a5507b640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6a50109700 0x7f6a50120a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a5507b640 1 -- 10.20.193.12:0/3353139983 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a50125d30 con 0x7f6a50108db0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a5507b640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 0x7f6a501204f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005a20 tx=0x7f6a40002d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a3e7fc640 1 -- 10.20.193.12:0/3353139983 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6a40046070 con 0x7f6a50108db0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a50125fc0 con 0x7f6a50108db0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a3e7fc640 1 -- 10.20.193.12:0/3353139983 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f6a400044b0 con 0x7f6a50108db0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a3e7fc640 1 -- 10.20.193.12:0/3353139983 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6a400416c0 con 0x7f6a50108db0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.607+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a50126570 con 0x7f6a50108db0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.608+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a50109bf0 con 0x7f6a50108db0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.609+0000 7f6a3e7fc640 1 -- 10.20.193.12:0/3353139983 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f6a40038a00 con 0x7f6a50108db0 2026-02-13T21:18:36.615 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.609+0000 7f6a3e7fc640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6a2c0793f0 0x7f6a2c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:36.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.609+0000 7f6a5487a640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6a2c0793f0 0x7f6a2c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:36.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.609+0000 7f6a3e7fc640 1 -- 10.20.193.12:0/3353139983 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6320+0+0 (secure 0 0 0) 0x7f6a4003e070 con 0x7f6a50108db0 2026-02-13T21:18:36.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.610+0000 7f6a5487a640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6a2c0793f0 0x7f6a2c099900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6a44005fd0 tx=0x7f6a440094d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:36.616 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.612+0000 7f6a3e7fc640 1 -- 10.20.193.12:0/3353139983 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f6a40050020 con 0x7f6a50108db0 2026-02-13T21:18:36.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.744+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a501091c0 con 0x7f6a50108db0 2026-02-13T21:18:36.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.744+0000 7f6a3e7fc640 1 -- 10.20.193.12:0/3353139983 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1901 (secure 0 0 0) 0x7f6a4008e770 con 0x7f6a50108db0 2026-02-13T21:18:36.748 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:36.748 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":2,"btime":"2026-02-13T21:18:36:309716+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":2,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T21:18:36.309326+0000","modified":"2026-02-13T21:18:36.309326+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2026-02-13T21:18:36.748 INFO:teuthology.orchestra.run.trial012.stderr:dumped fsmap epoch 2 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6a2c0793f0 msgr2=0x7f6a2c099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6a2c0793f0 0x7f6a2c099900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6a44005fd0 tx=0x7f6a440094d0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 msgr2=0x7f6a501204f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 0x7f6a501204f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005a20 tx=0x7f6a40002d90 comp rx=0 tx=0).stop 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 shutdown_connections 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6a2c0793f0 0x7f6a2c099900 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6a50109700 0x7f6a50120a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 --2- 10.20.193.12:0/3353139983 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6a50108db0 0x7f6a501204f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 >> 10.20.193.12:0/3353139983 conn(0x7f6a50062ae0 msgr2=0x7f6a50107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 shutdown_connections 2026-02-13T21:18:36.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:36.745+0000 7f6a57306640 1 -- 10.20.193.12:0/3353139983 wait complete. 2026-02-13T21:18:36.788 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T21:18:36.914 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:37.043 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.037+0000 7fd386afe640 1 -- 10.20.193.12:0/1989528987 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 msgr2=0x7fd380109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:37.043 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.037+0000 7fd386afe640 1 --2- 10.20.193.12:0/1989528987 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 0x7fd380109ce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd370005fd0 tx=0x7fd37002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.043 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.037+0000 7fd386afe640 1 -- 10.20.193.12:0/1989528987 shutdown_connections 2026-02-13T21:18:37.043 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.037+0000 7fd386afe640 1 --2- 10.20.193.12:0/1989528987 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd38010f210 0x7fd38010f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.043 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.037+0000 7fd386afe640 1 --2- 10.20.193.12:0/1989528987 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 0x7fd380109ce0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.043 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.037+0000 7fd386afe640 1 -- 10.20.193.12:0/1989528987 >> 10.20.193.12:0/1989528987 conn(0x7fd3800e7050 msgr2=0x7fd3801074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:37.043 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.037+0000 7fd386afe640 1 -- 10.20.193.12:0/1989528987 shutdown_connections 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.037+0000 7fd386afe640 1 -- 10.20.193.12:0/1989528987 wait complete. 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd386afe640 1 Processor -- start 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd386afe640 1 -- start start 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd386afe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 0x7fd3800e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd386afe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd38010f210 0x7fd3800e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd386afe640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd3801529f0 con 0x7fd3801098d0 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd386afe640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd380152870 con 0x7fd38010f210 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd384873640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 0x7fd3800e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd384873640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 0x7fd3800e7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42788/0 (socket says 10.20.193.12:42788) 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd384873640 1 -- 10.20.193.12:0/1417379079 learned_addr learned my addr 10.20.193.12:0/1417379079 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd377fff640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd38010f210 0x7fd3800e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:37.044 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd384873640 1 -- 10.20.193.12:0/1417379079 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd38010f210 msgr2=0x7fd3800e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd384873640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd38010f210 0x7fd3800e7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd384873640 1 -- 10.20.193.12:0/1417379079 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3800e94c0 con 0x7fd3801098d0 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd384873640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 0x7fd3800e7580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd370005a20 tx=0x7fd370004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd375ffb640 1 -- 10.20.193.12:0/1417379079 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd370046070 con 0x7fd3801098d0 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd375ffb640 1 -- 10.20.193.12:0/1417379079 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fd3700045a0 con 0x7fd3801098d0 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3800e8000 con 0x7fd3801098d0 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd375ffb640 1 -- 10.20.193.12:0/1417379079 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd370041750 con 0x7fd3801098d0 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.038+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3800f97d0 con 0x7fd3801098d0 2026-02-13T21:18:37.045 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.039+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38010ab50 con 0x7fd3801098d0 2026-02-13T21:18:37.046 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.040+0000 7fd375ffb640 1 -- 10.20.193.12:0/1417379079 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fd370038ae0 con 0x7fd3801098d0 2026-02-13T21:18:37.046 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.040+0000 7fd375ffb640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd35c0794c0 0x7fd35c0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:37.046 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.041+0000 7fd377fff640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd35c0794c0 0x7fd35c0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:37.046 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.041+0000 7fd375ffb640 1 -- 10.20.193.12:0/1417379079 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6320+0+0 (secure 0 0 0) 0x7fd37003e070 con 0x7fd3801098d0 2026-02-13T21:18:37.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.041+0000 7fd377fff640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd35c0794c0 0x7fd35c0999d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd368005ef0 tx=0x7fd368005e80 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:37.047 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.043+0000 7fd375ffb640 1 -- 10.20.193.12:0/1417379079 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fd370050080 con 0x7fd3801098d0 2026-02-13T21:18:37.179 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.175+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3800ea940 con 0x7fd3801098d0 2026-02-13T21:18:37.179 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.175+0000 7fd375ffb640 1 -- 10.20.193.12:0/1417379079 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1901 (secure 0 0 0) 0x7fd37008e5d0 con 0x7fd3801098d0 2026-02-13T21:18:37.180 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:37.180 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":2,"btime":"2026-02-13T21:18:36:309716+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":2,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T21:18:36.309326+0000","modified":"2026-02-13T21:18:36.309326+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2026-02-13T21:18:37.181 INFO:teuthology.orchestra.run.trial012.stderr:dumped fsmap epoch 2 2026-02-13T21:18:37.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd35c0794c0 msgr2=0x7fd35c0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:37.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd35c0794c0 0x7fd35c0999d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd368005ef0 tx=0x7fd368005e80 comp rx=0 tx=0).stop 2026-02-13T21:18:37.181 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 msgr2=0x7fd3800e7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:37.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 0x7fd3800e7580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd370005a20 tx=0x7fd370004060 comp rx=0 tx=0).stop 2026-02-13T21:18:37.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 shutdown_connections 2026-02-13T21:18:37.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd35c0794c0 0x7fd35c0999d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd38010f210 0x7fd3800e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 --2- 10.20.193.12:0/1417379079 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd3801098d0 0x7fd3800e7580 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 >> 10.20.193.12:0/1417379079 conn(0x7fd3800e7050 msgr2=0x7fd380054710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:37.182 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 shutdown_connections 2026-02-13T21:18:37.183 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.176+0000 7fd386afe640 1 -- 10.20.193.12:0/1417379079 wait complete. 2026-02-13T21:18:37.219 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T21:18:37.337 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:37.453 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2026-02-13T21:18:37.453 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: osdmap e48: 8 total, 8 up, 8 in 2026-02-13T21:18:37.453 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"} : dispatch 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: osdmap e49: 8 total, 8 up, 8 in 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: fsmap foo:0 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: Saving service mds.foo spec with placement count:2 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3353139983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:37.454 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:37.455 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:37 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1417379079' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:37.463 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.457+0000 7f2d01284640 1 -- 10.20.193.12:0/2065012807 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 msgr2=0x7f2cfc152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:37.463 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.457+0000 7f2d01284640 1 --2- 10.20.193.12:0/2065012807 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 0x7f2cfc152cb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4005fd0 tx=0x7f2ce402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.463 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 -- 10.20.193.12:0/2065012807 shutdown_connections 2026-02-13T21:18:37.463 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 --2- 10.20.193.12:0/2065012807 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 0x7f2cfc152cb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.463 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 --2- 10.20.193.12:0/2065012807 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cfc1094c0 0x7f2cfc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.463 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 -- 10.20.193.12:0/2065012807 >> 10.20.193.12:0/2065012807 conn(0x7f2cfc0e7050 msgr2=0x7f2cfc1074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:37.463 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 -- 10.20.193.12:0/2065012807 shutdown_connections 2026-02-13T21:18:37.463 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 -- 10.20.193.12:0/2065012807 wait complete. 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 Processor -- start 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 -- start start 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cfc1094c0 0x7f2cfc0f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 0x7f2cfc0f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc155d50 con 0x7f2cfc109e10 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2d01284640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc155bd0 con 0x7f2cfc1094c0 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2cfa575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 0x7f2cfc0f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2cfa575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 0x7f2cfc0f3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42804/0 (socket says 10.20.193.12:42804) 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2cfa575640 1 -- 10.20.193.12:0/2321145735 learned_addr learned my addr 10.20.193.12:0/2321145735 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2cfad76640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cfc1094c0 0x7f2cfc0f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2cfa575640 1 -- 10.20.193.12:0/2321145735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cfc1094c0 msgr2=0x7f2cfc0f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:37.464 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.458+0000 7f2cfa575640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cfc1094c0 0x7f2cfc0f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.465 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.459+0000 7f2cfa575640 1 -- 10.20.193.12:0/2321145735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cfc0f9150 con 0x7f2cfc109e10 2026-02-13T21:18:37.465 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.459+0000 7f2cfa575640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 0x7f2cfc0f3e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4002db0 tx=0x7f2ce4002de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:37.465 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.459+0000 7f2cdbfff640 1 -- 10.20.193.12:0/2321145735 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2ce4046070 con 0x7f2cfc109e10 2026-02-13T21:18:37.465 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.459+0000 7f2cdbfff640 1 -- 10.20.193.12:0/2321145735 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f2ce4004560 con 0x7f2cfc109e10 2026-02-13T21:18:37.465 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.459+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc0f93e0 con 0x7f2cfc109e10 2026-02-13T21:18:37.465 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.459+0000 7f2cdbfff640 1 -- 10.20.193.12:0/2321145735 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2ce40416c0 con 0x7f2cfc109e10 2026-02-13T21:18:37.465 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.459+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cfc0f9910 con 0x7f2cfc109e10 2026-02-13T21:18:37.465 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.459+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cfc054ab0 con 0x7f2cfc109e10 2026-02-13T21:18:37.466 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.460+0000 7f2cdbfff640 1 -- 10.20.193.12:0/2321145735 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f2ce4038a20 con 0x7f2cfc109e10 2026-02-13T21:18:37.466 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.461+0000 7f2cdbfff640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2cd00793f0 0x7f2cd0099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:37.466 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.461+0000 7f2cdbfff640 1 -- 10.20.193.12:0/2321145735 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6320+0+0 (secure 0 0 0) 0x7f2ce403e070 con 0x7f2cfc109e10 2026-02-13T21:18:37.466 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.461+0000 7f2cfad76640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2cd00793f0 0x7f2cd0099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:37.466 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.461+0000 7f2cfad76640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2cd00793f0 0x7f2cd0099900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0fa1e0 tx=0x7f2cf0005f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:37.467 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.464+0000 7f2cdbfff640 1 -- 10.20.193.12:0/2321145735 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f2ce408e2a0 con 0x7f2cfc109e10 2026-02-13T21:18:37.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2026-02-13T21:18:37.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: osdmap e48: 8 total, 8 up, 8 in 2026-02-13T21:18:37.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"} : dispatch 2026-02-13T21:18:37.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: osdmap e49: 8 total, 8 up, 8 in 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: fsmap foo:0 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: Saving service mds.foo spec with placement count:2 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3353139983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:37.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:37 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1417379079' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:37.577 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.572+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cfc0f9bc0 con 0x7f2cfc109e10 2026-02-13T21:18:37.577 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.573+0000 7f2cdbfff640 1 -- 10.20.193.12:0/2321145735 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+17657 (secure 0 0 0) 0x7f2ce40933a0 con 0x7f2cfc109e10 2026-02-13T21:18:37.578 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:37.578 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":50,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","created":"2026-02-13T21:16:19.758726+0000","modified":"2026-02-13T21:18:37.311442+0000","last_up_change":"2026-02-13T21:18:24.265543+0000","last_in_change":"2026-02-13T21:18:15.652245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T21:17:45.821822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2026-02-13T21:18:34.434230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2026-02-13T21:18:35.310732+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"cephfs":{"data":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de74b69e-730a-4162-a3cc-3daa616bf84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6802","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6803","nonce":1211901108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6804","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6805","nonce":1211901108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6808","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6809","nonce":1211901108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6806","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6807","nonce":1211901108}]},"public_addr":"10.20.193.12:6803/1211901108","cluster_addr":"10.20.193.12:6805/1211901108","heartbeat_back_addr":"10.20.193.12:6809/1211901108","heartbeat_front_addr":"10.20.193.12:6807/1211901108","state":["exists","up"]},{"osd":1,"uuid":"6118d6e3-09c9-4db8-b217-1c3327e2ea30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6810","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6811","nonce":2390579753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6812","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6813","nonce":2390579753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6816","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6817","nonce":2390579753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6814","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6815","nonce":2390579753}]},"public_addr":"10.20.193.12:6811/2390579753","cluster_addr":"10.20.193.12:6813/2390579753","heartbeat_back_addr":"10.20.193.12:6817/2390579753","heartbeat_front_addr":"10.20.193.12:6815/2390579753","state":["exists","up"]},{"osd":2,"uuid":"752d80ce-ee90-4e8a-9ccb-626e1ff2ce72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6818","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6819","nonce":1263676438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6820","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6821","nonce":1263676438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6824","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6825","nonce":1263676438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6822","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6823","nonce":1263676438}]},"public_addr":"10.20.193.12:6819/1263676438","cluster_addr":"10.20.193.12:6821/1263676438","heartbeat_back_addr":"10.20.193.12:6825/1263676438","heartbeat_front_addr":"10.20.193.12:6823/1263676438","state":["exists","up"]},{"osd":3,"uuid":"2e4c26bc-c190-453c-bd22-452337fb54fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6826","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6827","nonce":1782630321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6828","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6829","nonce":1782630321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6832","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6833","nonce":1782630321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6830","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6831","nonce":1782630321}]},"public_addr":"10.20.193.12:6827/1782630321","cluster_addr":"10.20.193.12:6829/1782630321","heartbeat_back_addr":"10.20.193.12:6833/1782630321","heartbeat_front_addr":"10.20.193.12:6831/1782630321","state":["exists","up"]},{"osd":4,"uuid":"2a92779e-4460-41dc-b18a-4c646ac46091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6801","nonce":1546978354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6803","nonce":1546978354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6807","nonce":1546978354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6805","nonce":1546978354}]},"public_addr":"10.20.193.90:6801/1546978354","cluster_addr":"10.20.193.90:6803/1546978354","heartbeat_back_addr":"10.20.193.90:6807/1546978354","heartbeat_front_addr":"10.20.193.90:6805/1546978354","state":["exists","up"]},{"osd":5,"uuid":"40f7e047-3d3d-4bd2-9964-d29a3ff11482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6809","nonce":2430801346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6811","nonce":2430801346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6815","nonce":2430801346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6813","nonce":2430801346}]},"public_addr":"10.20.193.90:6809/2430801346","cluster_addr":"10.20.193.90:6811/2430801346","heartbeat_back_addr":"10.20.193.90:6815/2430801346","heartbeat_front_addr":"10.20.193.90:6813/2430801346","state":["exists","up"]},{"osd":6,"uuid":"5837ab08-fa7e-4cc5-bb99-8c046a23cb8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6817","nonce":391511610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6819","nonce":391511610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6823","nonce":391511610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6821","nonce":391511610}]},"public_addr":"10.20.193.90:6817/391511610","cluster_addr":"10.20.193.90:6819/391511610","heartbeat_back_addr":"10.20.193.90:6823/391511610","heartbeat_front_addr":"10.20.193.90:6821/391511610","state":["exists","up"]},{"osd":7,"uuid":"3a9be97d-270f-4370-bb57-9a4510f4e7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6825","nonce":1694034982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6827","nonce":1694034982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6831","nonce":1694034982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6829","nonce":1694034982}]},"public_addr":"10.20.193.90:6825/1694034982","cluster_addr":"10.20.193.90:6827/1694034982","heartbeat_back_addr":"10.20.193.90:6831/1694034982","heartbeat_front_addr":"10.20.193.90:6829/1694034982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:28.184825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:35.247079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:42.366420+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:49.338130+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:57.851801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:06.994774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:13.782179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:22.858730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.12:0/1300378024":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/3296163882":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6801/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/172285562":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6800/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3542302382":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/72325951":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3948096534":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3481816594":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2322493062":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2357723980":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6800/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/3800148741":"2026-02-14T21:17:01.611190+0000","10.20.193.12:6800/3481816594":"2026-02-14T21:17:01.611190+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T21:18:37.579 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.574+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2cd00793f0 msgr2=0x7f2cd0099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:37.579 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.574+0000 7f2d01284640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2cd00793f0 0x7f2cd0099900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0fa1e0 tx=0x7f2cf0005f30 comp rx=0 tx=0).stop 2026-02-13T21:18:37.579 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 msgr2=0x7f2cfc0f3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:37.580 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 0x7f2cfc0f3e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4002db0 tx=0x7f2ce4002de0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.580 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 shutdown_connections 2026-02-13T21:18:37.580 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f2cd00793f0 0x7f2cd0099900 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.580 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f2cfc109e10 0x7f2cfc0f3e90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.580 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 --2- 10.20.193.12:0/2321145735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2cfc1094c0 0x7f2cfc0f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:37.580 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 >> 10.20.193.12:0/2321145735 conn(0x7f2cfc0e7050 msgr2=0x7f2cfc0ede50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:37.580 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 shutdown_connections 2026-02-13T21:18:37.580 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:37.575+0000 7f2d01284640 1 -- 10.20.193.12:0/2321145735 wait complete. 2026-02-13T21:18:37.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 2, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-13T21:18:36.309326+0000', 'modified': '2026-02-13T21:18:36.309326+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [], 'up': {}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'foo', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2026-02-13T21:18:37.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2026-02-13T21:18:38.571 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: osdmap e50: 8 total, 8 up, 8 in 2026-02-13T21:18:38.571 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2321145735' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: pgmap v86: 65 pgs: 8 creating+peering, 47 unknown, 10 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mds.foo.trial012.ebqplc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial012.ebqplc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T21:18:38.572 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:38.573 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:38 trial090 ceph-mon[42877]: Deploying daemon mds.foo.trial012.ebqplc on trial012 2026-02-13T21:18:38.621 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: osdmap e50: 8 total, 8 up, 8 in 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2321145735' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: pgmap v86: 65 pgs: 8 creating+peering, 47 unknown, 10 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:38.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mds.foo.trial012.ebqplc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T21:18:38.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial012.ebqplc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T21:18:38.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:38.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:38 trial012 ceph-mon[37926]: Deploying daemon mds.foo.trial012.ebqplc on trial012 2026-02-13T21:18:38.739 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:38.856 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 -- 10.20.193.12:0/1866063013 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f56341094c0 msgr2=0x7f56341098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:38.856 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 --2- 10.20.193.12:0/1866063013 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f56341094c0 0x7f56341098d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5620005fd0 tx=0x7f562002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 -- 10.20.193.12:0/1866063013 shutdown_connections 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 --2- 10.20.193.12:0/1866063013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5634109e10 0x7f5634152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 --2- 10.20.193.12:0/1866063013 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f56341094c0 0x7f56341098d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 -- 10.20.193.12:0/1866063013 >> 10.20.193.12:0/1866063013 conn(0x7f56340e7050 msgr2=0x7f56341074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 -- 10.20.193.12:0/1866063013 shutdown_connections 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 -- 10.20.193.12:0/1866063013 wait complete. 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.850+0000 7f563a07b640 1 Processor -- start 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f563a07b640 1 -- start start 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f563a07b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56341094c0 0x7f56340f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:38.857 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f563a07b640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5634109e10 0x7f56340f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f563a07b640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5634155db0 con 0x7f5634109e10 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f563a07b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5634155c30 con 0x7f56341094c0 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5632ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5634109e10 0x7f56340f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5632ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5634109e10 0x7f56340f3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:42846/0 (socket says 10.20.193.12:42846) 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5632ffd640 1 -- 10.20.193.12:0/3474727878 learned_addr learned my addr 10.20.193.12:0/3474727878 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f56337fe640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56341094c0 0x7f56340f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5632ffd640 1 -- 10.20.193.12:0/3474727878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56341094c0 msgr2=0x7f56340f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5632ffd640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56341094c0 0x7f56340f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5632ffd640 1 -- 10.20.193.12:0/3474727878 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56340f90b0 con 0x7f5634109e10 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5632ffd640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5634109e10 0x7f56340f3e40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5624005f30 tx=0x7f562400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:38.858 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5630ff9640 1 -- 10.20.193.12:0/3474727878 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5624014070 con 0x7f5634109e10 2026-02-13T21:18:38.859 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56340f93a0 con 0x7f5634109e10 2026-02-13T21:18:38.859 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5630ff9640 1 -- 10.20.193.12:0/3474727878 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f5624004d10 con 0x7f5634109e10 2026-02-13T21:18:38.859 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f5630ff9640 1 -- 10.20.193.12:0/3474727878 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5624005020 con 0x7f5634109e10 2026-02-13T21:18:38.859 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.851+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56340f99b0 con 0x7f5634109e10 2026-02-13T21:18:38.859 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.852+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f8005390 con 0x7f5634109e10 2026-02-13T21:18:38.859 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.853+0000 7f5630ff9640 1 -- 10.20.193.12:0/3474727878 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f56240047a0 con 0x7f5634109e10 2026-02-13T21:18:38.860 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.853+0000 7f5630ff9640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f56080793f0 0x7f5608099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:38.860 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.853+0000 7f5630ff9640 1 -- 10.20.193.12:0/3474727878 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6320+0+0 (secure 0 0 0) 0x7f562409ca60 con 0x7f5634109e10 2026-02-13T21:18:38.860 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.853+0000 7f56337fe640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f56080793f0 0x7f5608099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:38.860 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.854+0000 7f56337fe640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f56080793f0 0x7f5608099900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5620002400 tx=0x7f562003a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:38.860 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.856+0000 7f5630ff9640 1 -- 10.20.193.12:0/3474727878 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f5624069870 con 0x7f5634109e10 2026-02-13T21:18:38.992 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.988+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55f8005680 con 0x7f5634109e10 2026-02-13T21:18:38.992 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.988+0000 7f5630ff9640 1 -- 10.20.193.12:0/3474727878 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1901 (secure 0 0 0) 0x7f562406e970 con 0x7f5634109e10 2026-02-13T21:18:38.993 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:38.993 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":2,"btime":"2026-02-13T21:18:36:309716+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":2,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T21:18:36.309326+0000","modified":"2026-02-13T21:18:36.309326+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2026-02-13T21:18:38.994 INFO:teuthology.orchestra.run.trial012.stderr:dumped fsmap epoch 2 2026-02-13T21:18:38.994 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f56080793f0 msgr2=0x7f5608099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:38.994 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f56080793f0 0x7f5608099900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5620002400 tx=0x7f562003a040 comp rx=0 tx=0).stop 2026-02-13T21:18:38.994 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5634109e10 msgr2=0x7f56340f3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:38.994 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5634109e10 0x7f56340f3e40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5624005f30 tx=0x7f562400db40 comp rx=0 tx=0).stop 2026-02-13T21:18:38.994 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 shutdown_connections 2026-02-13T21:18:38.994 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f56080793f0 0x7f5608099900 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:38.994 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f5634109e10 0x7f56340f3e40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:38.995 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 --2- 10.20.193.12:0/3474727878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56341094c0 0x7f56340f38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:38.995 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 >> 10.20.193.12:0/3474727878 conn(0x7f56340e7050 msgr2=0x7f56340ede40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:38.995 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 shutdown_connections 2026-02-13T21:18:38.995 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:38.989+0000 7f563a07b640 1 -- 10.20.193.12:0/3474727878 wait complete. 2026-02-13T21:18:39.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 2, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-13T21:18:36.309326+0000', 'modified': '2026-02-13T21:18:36.309326+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [], 'up': {}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'foo', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2026-02-13T21:18:39.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: osdmap e51: 8 total, 8 up, 8 in 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mds.foo.trial090.ppgikq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial090.ppgikq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: Deploying daemon mds.foo.trial090.ppgikq on trial090 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3474727878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.541 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:39 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:39.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: osdmap e51: 8 total, 8 up, 8 in 2026-02-13T21:18:39.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mds.foo.trial090.ppgikq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial090.ppgikq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: Deploying daemon mds.foo.trial090.ppgikq on trial090 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3474727878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:39.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:39 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:40.034 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T21:18:40.152 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:40.270 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.264+0000 7f6eba6f2640 1 -- 10.20.193.12:0/2859354577 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb41125c0 msgr2=0x7f6eb41129d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.270 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.264+0000 7f6eba6f2640 1 --2- 10.20.193.12:0/2859354577 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb41125c0 0x7f6eb41129d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005fd0 tx=0x7f6ea402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.270 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.264+0000 7f6eba6f2640 1 -- 10.20.193.12:0/2859354577 shutdown_connections 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.264+0000 7f6eba6f2640 1 --2- 10.20.193.12:0/2859354577 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb41125c0 0x7f6eb41129d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.264+0000 7f6eba6f2640 1 --2- 10.20.193.12:0/2859354577 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6eb410cc80 0x7f6eb410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.264+0000 7f6eba6f2640 1 -- 10.20.193.12:0/2859354577 >> 10.20.193.12:0/2859354577 conn(0x7f6eb40ea4b0 msgr2=0x7f6eb410a900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.264+0000 7f6eba6f2640 1 -- 10.20.193.12:0/2859354577 shutdown_connections 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.264+0000 7f6eba6f2640 1 -- 10.20.193.12:0/2859354577 wait complete. 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eba6f2640 1 Processor -- start 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eba6f2640 1 -- start start 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eba6f2640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb410cc80 0x7f6eb411adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eba6f2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6eb41125c0 0x7f6eb411b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.271 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eba6f2640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb4155d60 con 0x7f6eb410cc80 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eba6f2640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb4155be0 con 0x7f6eb41125c0 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eb3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb410cc80 0x7f6eb411adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eb3fff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb410cc80 0x7f6eb411adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50906/0 (socket says 10.20.193.12:50906) 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eb3fff640 1 -- 10.20.193.12:0/289246063 learned_addr learned my addr 10.20.193.12:0/289246063 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eb3fff640 1 -- 10.20.193.12:0/289246063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6eb41125c0 msgr2=0x7f6eb411b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eb3fff640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6eb41125c0 0x7f6eb411b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eb3fff640 1 -- 10.20.193.12:0/289246063 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb4120600 con 0x7f6eb410cc80 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.265+0000 7f6eb3fff640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb410cc80 0x7f6eb411adc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000d8d0 tx=0x7f6ea000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.266+0000 7f6eb17fa640 1 -- 10.20.193.12:0/289246063 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6ea0014070 con 0x7f6eb410cc80 2026-02-13T21:18:40.272 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.266+0000 7f6eb17fa640 1 -- 10.20.193.12:0/289246063 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f6ea000bcd0 con 0x7f6eb410cc80 2026-02-13T21:18:40.273 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.266+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb41208f0 con 0x7f6eb410cc80 2026-02-13T21:18:40.273 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.266+0000 7f6eb17fa640 1 -- 10.20.193.12:0/289246063 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6ea0002cc0 con 0x7f6eb410cc80 2026-02-13T21:18:40.273 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.266+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb4120f00 con 0x7f6eb410cc80 2026-02-13T21:18:40.273 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.266+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb410df00 con 0x7f6eb410cc80 2026-02-13T21:18:40.274 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.267+0000 7f6eb17fa640 1 -- 10.20.193.12:0/289246063 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f6ea000b840 con 0x7f6eb410cc80 2026-02-13T21:18:40.274 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.268+0000 7f6eb17fa640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e880794c0 0x7f6e880999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.274 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.268+0000 7f6eb37fe640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e880794c0 0x7f6e880999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.274 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.268+0000 7f6eb17fa640 1 -- 10.20.193.12:0/289246063 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6320+0+0 (secure 0 0 0) 0x7f6ea009ca50 con 0x7f6eb410cc80 2026-02-13T21:18:40.274 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.268+0000 7f6eb37fe640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e880794c0 0x7f6e880999d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6eb410f570 tx=0x7f6ea4005930 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:40.274 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.270+0000 7f6eb17fa640 1 -- 10.20.193.12:0/289246063 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f6ea0069860 con 0x7f6eb410cc80 2026-02-13T21:18:40.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.410+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6eb410d090 con 0x7f6eb410cc80 2026-02-13T21:18:40.414 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.411+0000 7f6eb17fa640 1 -- 10.20.193.12:0/289246063 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3604 (secure 0 0 0) 0x7f6ea006e960 con 0x7f6eb410cc80 2026-02-13T21:18:40.415 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:40.415 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":6,"btime":"2026-02-13T21:18:40:330080+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14674,"name":"foo.trial012.ebqplc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.12:6835/3171735297","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6834","nonce":3171735297},{"type":"v1","addr":"10.20.193.12:6835","nonce":3171735297}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T21:18:36.309326+0000","modified":"2026-02-13T21:18:40.326290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24407},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24407":{"gid":24407,"name":"foo.trial090.ppgikq","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"10.20.193.90:6833/705792844","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":705792844},{"type":"v1","addr":"10.20.193.90:6833","nonce":705792844}]},"join_fscid":1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24407,"qdb_cluster":[24407]},"id":1}]} 2026-02-13T21:18:40.416 INFO:teuthology.orchestra.run.trial012.stderr:dumped fsmap epoch 6 2026-02-13T21:18:40.416 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.412+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e880794c0 msgr2=0x7f6e880999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.412+0000 7f6eba6f2640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e880794c0 0x7f6e880999d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6eb410f570 tx=0x7f6ea4005930 comp rx=0 tx=0).stop 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.412+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb410cc80 msgr2=0x7f6eb411adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.413+0000 7f6eba6f2640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb410cc80 0x7f6eb411adc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000d8d0 tx=0x7f6ea000dda0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.413+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 shutdown_connections 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.413+0000 7f6eba6f2640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f6e880794c0 0x7f6e880999d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.413+0000 7f6eba6f2640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6eb41125c0 0x7f6eb411b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.413+0000 7f6eba6f2640 1 --2- 10.20.193.12:0/289246063 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f6eb410cc80 0x7f6eb411adc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.413+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 >> 10.20.193.12:0/289246063 conn(0x7f6eb40ea4b0 msgr2=0x7f6eb41105b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.413+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 shutdown_connections 2026-02-13T21:18:40.417 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.413+0000 7f6eba6f2640 1 -- 10.20.193.12:0/289246063 wait complete. 2026-02-13T21:18:40.432 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.12:6834/3171735297,v1:10.20.193.12:6835/3171735297] up:boot 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] up:boot 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: daemon mds.foo.trial090.ppgikq assigned to filesystem foo as rank 0 (now has 1 ranks) 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: Cluster is now healthy 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: fsmap foo:0 2 up:standby 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "foo.trial012.ebqplc"} : dispatch 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "foo.trial090.ppgikq"} : dispatch 2026-02-13T21:18:40.433 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: fsmap foo:1 {0=foo.trial090.ppgikq=up:creating} 1 up:standby 2026-02-13T21:18:40.434 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: daemon mds.foo.trial090.ppgikq is now active in filesystem foo as rank 0 2026-02-13T21:18:40.434 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: pgmap v88: 65 pgs: 8 creating+peering, 28 unknown, 29 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:40.434 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:40.434 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:40.434 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:40.434 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:40 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:40.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-13T21:18:36.309326+0000', 'modified': '2026-02-13T21:18:40.326290+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24407}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24407': {'gid': 24407, 'name': 'foo.trial090.ppgikq', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '10.20.193.90:6833/705792844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6832', 'nonce': 705792844}, {'type': 'v1', 'addr': '10.20.193.90:6833', 'nonce': 705792844}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'foo', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24407, 'qdb_cluster': [24407]} 2026-02-13T21:18:40.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-13T21:18:40.455 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell mds.foo.trial090.ppgikq status 2026-02-13T21:18:40.614 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:40.652 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.12:6834/3171735297,v1:10.20.193.12:6835/3171735297] up:boot 2026-02-13T21:18:40.652 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] up:boot 2026-02-13T21:18:40.652 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: daemon mds.foo.trial090.ppgikq assigned to filesystem foo as rank 0 (now has 1 ranks) 2026-02-13T21:18:40.652 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-13T21:18:40.652 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T21:18:40.652 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: Cluster is now healthy 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: fsmap foo:0 2 up:standby 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "foo.trial012.ebqplc"} : dispatch 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "foo.trial090.ppgikq"} : dispatch 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: fsmap foo:1 {0=foo.trial090.ppgikq=up:creating} 1 up:standby 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: daemon mds.foo.trial090.ppgikq is now active in filesystem foo as rank 0 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: pgmap v88: 65 pgs: 8 creating+peering, 28 unknown, 29 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:40.653 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:40 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:40.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.726+0000 7fbf71061640 1 -- 10.20.193.12:0/977437588 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c109df0 msgr2=0x7fbf6c152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.726+0000 7fbf71061640 1 --2- 10.20.193.12:0/977437588 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c109df0 0x7fbf6c152c90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009930 tx=0x7fbf5402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 -- 10.20.193.12:0/977437588 shutdown_connections 2026-02-13T21:18:40.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 --2- 10.20.193.12:0/977437588 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c109df0 0x7fbf6c152c90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.733 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 --2- 10.20.193.12:0/977437588 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6c1094a0 0x7fbf6c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 -- 10.20.193.12:0/977437588 >> 10.20.193.12:0/977437588 conn(0x7fbf6c0e70b0 msgr2=0x7fbf6c107500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 -- 10.20.193.12:0/977437588 shutdown_connections 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 -- 10.20.193.12:0/977437588 wait complete. 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 Processor -- start 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 -- start start 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c1094a0 0x7fbf6c0f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6c109df0 0x7fbf6c0f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c155dd0 con 0x7fbf6c1094a0 2026-02-13T21:18:40.734 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf71061640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c155c50 con 0x7fbf6c109df0 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf6ad76640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c1094a0 0x7fbf6c0f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf6ad76640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c1094a0 0x7fbf6c0f42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50936/0 (socket says 10.20.193.12:50936) 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf6ad76640 1 -- 10.20.193.12:0/107852903 learned_addr learned my addr 10.20.193.12:0/107852903 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf6a575640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6c109df0 0x7fbf6c0f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf6ad76640 1 -- 10.20.193.12:0/107852903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6c109df0 msgr2=0x7fbf6c0f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.727+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6c109df0 0x7fbf6c0f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.728+0000 7fbf6ad76640 1 -- 10.20.193.12:0/107852903 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c0f9b20 con 0x7fbf6c1094a0 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.728+0000 7fbf6a575640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6c109df0 0x7fbf6c0f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:40.735 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.728+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c1094a0 0x7fbf6c0f42e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbf600094b0 tx=0x7fbf6000ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:40.736 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.728+0000 7fbf4bfff640 1 -- 10.20.193.12:0/107852903 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf6000cac0 con 0x7fbf6c1094a0 2026-02-13T21:18:40.736 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.728+0000 7fbf71061640 1 -- 10.20.193.12:0/107852903 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6c0f9e10 con 0x7fbf6c1094a0 2026-02-13T21:18:40.736 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.728+0000 7fbf4bfff640 1 -- 10.20.193.12:0/107852903 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fbf60004d10 con 0x7fbf6c1094a0 2026-02-13T21:18:40.736 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.728+0000 7fbf4bfff640 1 -- 10.20.193.12:0/107852903 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf60005720 con 0x7fbf6c1094a0 2026-02-13T21:18:40.736 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.728+0000 7fbf71061640 1 -- 10.20.193.12:0/107852903 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6c0fa3a0 con 0x7fbf6c1094a0 2026-02-13T21:18:40.736 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.729+0000 7fbf4bfff640 1 -- 10.20.193.12:0/107852903 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fbf600047a0 con 0x7fbf6c1094a0 2026-02-13T21:18:40.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf4bfff640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbf40079570 0x7fbf40099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf4bfff640 1 -- 10.20.193.12:0/107852903 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6320+0+0 (secure 0 0 0) 0x7fbf6009cdc0 con 0x7fbf6c1094a0 2026-02-13T21:18:40.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf6a575640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbf40079570 0x7fbf40099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf775b4e00 1 Processor -- start 2026-02-13T21:18:40.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf775b4e00 1 -- start start 2026-02-13T21:18:40.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf6a575640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbf40079570 0x7fbf40099a80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005fd0 tx=0x7fbf5403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:40.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf775b4e00 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce4dc720 0x5564ce941b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.744 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf775b4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce50e5b0 0x5564ce9420d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf775b4e00 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x5564ce8599a0 con 0x5564ce4dc720 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf775b4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5564ce7fa880 con 0x5564ce50e5b0 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf6ad76640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce4dc720 0x5564ce941b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf6ad76640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce4dc720 0x5564ce941b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50950/0 (socket says 10.20.193.12:50950) 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.730+0000 7fbf6ad76640 1 -- 10.20.193.12:0/1593742018 learned_addr learned my addr 10.20.193.12:0/1593742018 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf6ad76640 1 -- 10.20.193.12:0/1593742018 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce50e5b0 msgr2=0x5564ce9420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/1593742018 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce50e5b0 0x5564ce9420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf6ad76640 1 -- 10.20.193.12:0/1593742018 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ce8b1c90 con 0x5564ce4dc720 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/1593742018 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce4dc720 0x5564ce941b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbf60064480 tx=0x7fbf60063d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6b87c73b93dc3e server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf377fe640 1 -- 10.20.193.12:0/1593742018 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf60069bd0 con 0x5564ce4dc720 2026-02-13T21:18:40.745 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf377fe640 1 -- 10.20.193.12:0/1593742018 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fbf6006ecd0 con 0x5564ce4dc720 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf377fe640 1 -- 10.20.193.12:0/1593742018 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf600040d0 con 0x5564ce4dc720 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1593742018 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce4dc720 msgr2=0x5564ce941b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/1593742018 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce4dc720 0x5564ce941b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbf60064480 tx=0x7fbf60063d10 comp rx=0 tx=0).stop 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1593742018 shutdown_connections 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/1593742018 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce50e5b0 0x5564ce9420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/1593742018 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce4dc720 0x5564ce941b90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1593742018 >> 10.20.193.12:0/1593742018 conn(0x5564ce5170e0 msgr2=0x5564ce940470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1593742018 shutdown_connections 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.731+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1593742018 wait complete. 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.732+0000 7fbf775b4e00 1 -- start start 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.732+0000 7fbf775b4e00 1 Processor -- start 2026-02-13T21:18:40.746 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.732+0000 7fbf775b4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce95b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.732+0000 7fbf775b4e00 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce50e5b0 0x5564ce95b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.732+0000 7fbf775b4e00 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x5564ce635d60 con 0x5564ce50e5b0 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.732+0000 7fbf775b4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5564ce95bbd0 con 0x5564ce4dc720 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 10 client.0 _ll_register_callbacks cb 0x5564ce7f70c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6a575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce50e5b0 0x5564ce95b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6a575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce50e5b0 0x5564ce95b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50956/0 (socket says 10.20.193.12:50956) 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6a575640 1 -- 10.20.193.12:0/1063953168 learned_addr learned my addr 10.20.193.12:0/1063953168 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce95b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6a575640 1 -- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 msgr2=0x5564ce95b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T21:18:40.747 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6a575640 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce95b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6a575640 1 -- 10.20.193.12:0/1063953168 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ce953f70 con 0x5564ce50e5b0 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce95b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf6a575640 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce50e5b0 0x5564ce95b5d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0532d0 tx=0x7fbf54005930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777197d9278bf423 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf34ff9640 10 client.0 ms_handle_connect on v2:10.20.193.12:3300/0 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf34ff9640 1 -- 10.20.193.12:0/1063953168 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf540388c0 con 0x5564ce50e5b0 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf34ff9640 1 -- 10.20.193.12:0/1063953168 <== mon.0 v2:10.20.193.12:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6320+0+0 (secure 0 0 0) 0x7fbf5403f050 con 0x5564ce50e5b0 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1063953168 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564ce868c40 con 0x5564ce50e5b0 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf34ff9640 1 -- 10.20.193.12:0/1063953168 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fbf54038a60 con 0x5564ce50e5b0 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 10 client.14694 fetch_fsmap learned FSMap version 6 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1063953168 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=3+}) -- 0x5564ce526680 con 0x5564ce50e5b0 2026-02-13T21:18:40.748 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf34ff9640 1 -- 10.20.193.12:0/1063953168 <== mon.0 v2:10.20.193.12:3300/0 4 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x5564ce868c40 con 0x5564ce50e5b0 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf34ff9640 1 -- 10.20.193.12:0/1063953168 <== mon.0 v2:10.20.193.12:3300/0 5 ==== fsmap(e 6) ==== 2325+0+0 (secure 0 0 0) 0x7fbf54056050 con 0x5564ce50e5b0 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 10 client.14694 fetch_fsmap finished waiting for FSMap version 6 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 10 client.14694 resolve_mds: resolved name 'foo.trial090.ppgikq' to daemon mds.foo.trial090.ppgikq 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 20 client.14694 populate_metadata read hostname 'trial012' 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] conn(0x5564ce516790 0x5564ce9c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 4 client.14694 mds_command: new command op to 24407 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.733+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1063953168 --> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564ce864440 con 0x5564ce516790 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.734+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] conn(0x5564ce516790 0x5564ce9c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.734+0000 7fbf34ff9640 10 client.14694 ms_handle_connect on v2:10.20.193.90:6832/705792844 2026-02-13T21:18:40.749 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.734+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] conn(0x5564ce516790 0x5564ce9c51b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97b37368ae29ae2 server_cookie=5688355336aa83ff in_seq=0 out_seq=0 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf34ff9640 1 -- 10.20.193.12:0/1063953168 <== mds.0 v2:10.20.193.90:6832/705792844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5564ce864440 con 0x5564ce516790 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf34ff9640 10 client.14694 handle_command_reply: tid=0 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 client.14694 shutdown 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1063953168 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce50e5b0 msgr2=0x5564ce95b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce50e5b0 0x5564ce95b5d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0532d0 tx=0x7fbf54005930 comp rx=0 tx=0).stop 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1063953168 shutdown_connections 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] conn(0x5564ce516790 0x5564ce9c51b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce50e5b0 0x5564ce95b5d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/1063953168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce95b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf34ff9640 0 client.14694 ms_handle_reset on v2:10.20.193.90:6832/705792844 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1063953168 >> 10.20.193.12:0/1063953168 conn(0x5564ce5170e0 msgr2=0x5564ce940c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:40.750 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1063953168 shutdown_connections 2026-02-13T21:18:40.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 1 -- 10.20.193.12:0/1063953168 wait complete. 2026-02-13T21:18:40.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.735+0000 7fbf775b4e00 20 client.14694 trim_cache size 0 max 16384 2026-02-13T21:18:40.756 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf775b4e00 1 Processor -- start 2026-02-13T21:18:40.756 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf775b4e00 1 -- start start 2026-02-13T21:18:40.756 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf775b4e00 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce945140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.756 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf775b4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce95b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.756 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf775b4e00 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1000b560 con 0x5564ce5170e0 2026-02-13T21:18:40.756 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf775b4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1000a5e0 con 0x5564ce4dc720 2026-02-13T21:18:40.756 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf6ad76640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce945140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf6ad76640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce945140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50972/0 (socket says 10.20.193.12:50972) 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf6ad76640 1 -- 10.20.193.12:0/3120259067 learned_addr learned my addr 10.20.193.12:0/3120259067 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf6ad76640 1 -- 10.20.193.12:0/3120259067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 msgr2=0x5564ce95b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/3120259067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce95b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.744+0000 7fbf6ad76640 1 -- 10.20.193.12:0/3120259067 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ce618950 con 0x5564ce5170e0 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/3120259067 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce945140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf60069d40 tx=0x7fbf60004fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d3b3c9b034c9fb server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf36ffd640 1 -- 10.20.193.12:0/3120259067 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf6006c070 con 0x5564ce5170e0 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf36ffd640 1 -- 10.20.193.12:0/3120259067 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fbf600631a0 con 0x5564ce5170e0 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf36ffd640 1 -- 10.20.193.12:0/3120259067 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf6007b9f0 con 0x5564ce5170e0 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf775b4e00 1 -- 10.20.193.12:0/3120259067 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 msgr2=0x5564ce945140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/3120259067 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce945140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf60069d40 tx=0x7fbf60004fe0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.757 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf775b4e00 1 -- 10.20.193.12:0/3120259067 shutdown_connections 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/3120259067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce95b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/3120259067 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce945140 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf775b4e00 1 -- 10.20.193.12:0/3120259067 >> 10.20.193.12:0/3120259067 conn(0x5564ce95efc0 msgr2=0x5564ce95f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf775b4e00 1 -- 10.20.193.12:0/3120259067 shutdown_connections 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.745+0000 7fbf775b4e00 1 -- 10.20.193.12:0/3120259067 wait complete. 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf775b4e00 1 -- start start 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf775b4e00 1 Processor -- start 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf775b4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce922990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf775b4e00 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce922f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf775b4e00 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x5564ce855230 con 0x5564ce5170e0 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf775b4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5564ce9a39f0 con 0x5564ce4dc720 2026-02-13T21:18:40.758 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf775b4e00 10 client.0 _ll_register_callbacks cb 0x5564ce8093f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf6a575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce922f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf6a575640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce922f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50974/0 (socket says 10.20.193.12:50974) 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf6a575640 1 -- 10.20.193.12:0/4164527436 learned_addr learned my addr 10.20.193.12:0/4164527436 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce922990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf6a575640 1 -- 10.20.193.12:0/4164527436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 msgr2=0x5564ce922990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf6a575640 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce922990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf6a575640 1 -- 10.20.193.12:0/4164527436 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ce953da0 con 0x5564ce5170e0 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf6a575640 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce922f70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbf54002400 tx=0x7fbf5402faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855f3a8f48806eaf server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf34ff9640 10 client.0 ms_handle_connect on v2:10.20.193.12:3300/0 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf34ff9640 1 -- 10.20.193.12:0/4164527436 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbf540423f0 con 0x5564ce5170e0 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf34ff9640 1 -- 10.20.193.12:0/4164527436 <== mon.0 v2:10.20.193.12:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6320+0+0 (secure 0 0 0) 0x7fbf54042590 con 0x5564ce5170e0 2026-02-13T21:18:40.759 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.746+0000 7fbf775b4e00 1 -- 10.20.193.12:0/4164527436 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf600631a0 con 0x5564ce5170e0 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf34ff9640 1 -- 10.20.193.12:0/4164527436 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fbf54069050 con 0x5564ce5170e0 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf775b4e00 10 client.14698 fetch_fsmap learned FSMap version 6 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf775b4e00 1 -- 10.20.193.12:0/4164527436 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=3+}) -- 0x5564ce953960 con 0x5564ce5170e0 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf34ff9640 1 -- 10.20.193.12:0/4164527436 <== mon.0 v2:10.20.193.12:3300/0 4 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fbf600631a0 con 0x5564ce5170e0 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf34ff9640 1 -- 10.20.193.12:0/4164527436 <== mon.0 v2:10.20.193.12:3300/0 5 ==== fsmap(e 6) ==== 2325+0+0 (secure 0 0 0) 0x7fbf5406c020 con 0x5564ce5170e0 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf775b4e00 10 client.14698 fetch_fsmap finished waiting for FSMap version 6 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf775b4e00 10 client.14698 resolve_mds: resolved name 'foo.trial090.ppgikq' to daemon mds.foo.trial090.ppgikq 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf775b4e00 20 client.14698 populate_metadata read hostname 'trial012' 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] conn(0x5564ce50e5b0 0x5564cea35de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf775b4e00 4 client.14698 mds_command: new command op to 24407 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf775b4e00 1 -- 10.20.193.12:0/4164527436 --> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] -- command(tid 0: {"prefix": "status"}) -- 0x5564ce861870 con 0x5564ce50e5b0 2026-02-13T21:18:40.760 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] conn(0x5564ce50e5b0 0x5564cea35de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf6ad76640 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] conn(0x5564ce50e5b0 0x5564cea35de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eef1d7ea53693085 server_cookie=ecb7b0f66cad1cf in_seq=0 out_seq=0 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.747+0000 7fbf34ff9640 10 client.14698 ms_handle_connect on v2:10.20.193.90:6832/705792844 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf34ff9640 1 -- 10.20.193.12:0/4164527436 <== mds.0 v2:10.20.193.90:6832/705792844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1204 (crc 0 0 0) 0x5564ce861870 con 0x5564ce50e5b0 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf34ff9640 10 client.14698 handle_command_reply: tid=0 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 client.14698 shutdown 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 -- 10.20.193.12:0/4164527436 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 msgr2=0x5564ce922f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce922f70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbf54002400 tx=0x7fbf5402faf0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 -- 10.20.193.12:0/4164527436 shutdown_connections 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] conn(0x5564ce50e5b0 0x5564cea35de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x5564ce5170e0 0x5564ce922f70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf34ff9640 0 client.14698 ms_handle_reset on v2:10.20.193.90:6832/705792844 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 --2- 10.20.193.12:0/4164527436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5564ce4dc720 0x5564ce922990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.761 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 -- 10.20.193.12:0/4164527436 >> 10.20.193.12:0/4164527436 conn(0x5564ce95efc0 msgr2=0x5564ce95c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:40.762 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 -- 10.20.193.12:0/4164527436 shutdown_connections 2026-02-13T21:18:40.762 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 1 -- 10.20.193.12:0/4164527436 wait complete. 2026-02-13T21:18:40.762 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf775b4e00 20 client.14698 trim_cache size 0 max 16384 2026-02-13T21:18:40.762 INFO:teuthology.orchestra.run.trial012.stdout:{ 2026-02-13T21:18:40.762 INFO:teuthology.orchestra.run.trial012.stdout: "cluster_fsid": "3551db35-0921-11f1-800a-d404e6e7d460", 2026-02-13T21:18:40.762 INFO:teuthology.orchestra.run.trial012.stdout: "whoami": 0, 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "id": 24407, 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "want_state": "up:active", 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "state": "up:active", 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "fs_name": "foo", 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "rank_uptime": 1.423061149, 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "mdsmap_epoch": 5, 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "osdmap_epoch": 51, 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "osdmap_epoch_barrier": 51, 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "uptime": 1.7444982790000001, 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "sysinfo": { 2026-02-13T21:18:40.763 INFO:teuthology.orchestra.run.trial012.stdout: "arch": "x86_64", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "ceph_release": "tentacle", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "ceph_version": "ceph version 20.2.0-690-g3baf6bae (3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) tentacle (stable - Debug)", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "ceph_version_short": "20.2.0-690-g3baf6bae", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "container_hostname": "trial090", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "distro": "centos", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "distro_description": "CentOS Stream 9", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "distro_version": "9", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "hostname": "trial090", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-13T21:18:40.764 INFO:teuthology.orchestra.run.trial012.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-13T21:18:40.765 INFO:teuthology.orchestra.run.trial012.stdout: "mem_swap_kb": "8388604", 2026-02-13T21:18:40.765 INFO:teuthology.orchestra.run.trial012.stdout: "mem_total_kb": "130438948", 2026-02-13T21:18:40.765 INFO:teuthology.orchestra.run.trial012.stdout: "os": "Linux" 2026-02-13T21:18:40.765 INFO:teuthology.orchestra.run.trial012.stdout: }, 2026-02-13T21:18:40.765 INFO:teuthology.orchestra.run.trial012.stdout: "endian": "little" 2026-02-13T21:18:40.765 INFO:teuthology.orchestra.run.trial012.stdout:} 2026-02-13T21:18:40.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 -- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbf40079570 msgr2=0x7fbf40099a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.766 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbf40079570 0x7fbf40099a80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005fd0 tx=0x7fbf5403a040 comp rx=0 tx=0).stop 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 -- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c1094a0 msgr2=0x7fbf6c0f42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c1094a0 0x7fbf6c0f42e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbf600094b0 tx=0x7fbf6000ede0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 -- 10.20.193.12:0/107852903 shutdown_connections 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fbf40079570 0x7fbf40099a80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6c109df0 0x7fbf6c0f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 --2- 10.20.193.12:0/107852903 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fbf6c1094a0 0x7fbf6c0f42e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 -- 10.20.193.12:0/107852903 >> 10.20.193.12:0/107852903 conn(0x7fbf6c0e70b0 msgr2=0x7fbf6c0ea720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 -- 10.20.193.12:0/107852903 shutdown_connections 2026-02-13T21:18:40.767 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:40.748+0000 7fbf71061640 1 -- 10.20.193.12:0/107852903 wait complete. 2026-02-13T21:18:40.787 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-13T21:18:40.801 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial012.front.sepia.ceph.com 2026-02-13T21:18:40.802 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph fs fail foo' 2026-02-13T21:18:40.920 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:41.034 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.028+0000 7f48dbfdb640 1 -- 10.20.193.12:0/166534588 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 msgr2=0x7f48d410dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:41.034 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 --2- 10.20.193.12:0/166534588 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 0x7f48d410dda0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f48c8005fd0 tx=0x7f48c802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.034 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 -- 10.20.193.12:0/166534588 shutdown_connections 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 --2- 10.20.193.12:0/166534588 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 0x7f48d410dda0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 --2- 10.20.193.12:0/166534588 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48d410c860 0x7f48d410ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 -- 10.20.193.12:0/166534588 >> 10.20.193.12:0/166534588 conn(0x7f48d40e9f00 msgr2=0x7f48d410a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 -- 10.20.193.12:0/166534588 shutdown_connections 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 -- 10.20.193.12:0/166534588 wait complete. 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 Processor -- start 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 -- start start 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48d410c860 0x7f48d40f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 0x7f48d40f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f48d41516a0 con 0x7f48d410d990 2026-02-13T21:18:41.035 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48dbfdb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48d4151520 con 0x7f48d410c860 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48d954f640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 0x7f48d40f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48d954f640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 0x7f48d40f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:50994/0 (socket says 10.20.193.12:50994) 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48d954f640 1 -- 10.20.193.12:0/476546410 learned_addr learned my addr 10.20.193.12:0/476546410 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48d9d50640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48d410c860 0x7f48d40f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48d954f640 1 -- 10.20.193.12:0/476546410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48d410c860 msgr2=0x7f48d40f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.029+0000 7f48d954f640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48d410c860 0x7f48d40f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.030+0000 7f48d954f640 1 -- 10.20.193.12:0/476546410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d40f7340 con 0x7f48d410d990 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.030+0000 7f48d954f640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 0x7f48d40f6750 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009580 tx=0x7f48c8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.030+0000 7f48c2ffd640 1 -- 10.20.193.12:0/476546410 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f48c8046070 con 0x7f48d410d990 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.030+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d40f75d0 con 0x7f48d410d990 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.030+0000 7f48c2ffd640 1 -- 10.20.193.12:0/476546410 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f48c8038900 con 0x7f48d410d990 2026-02-13T21:18:41.036 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.030+0000 7f48c2ffd640 1 -- 10.20.193.12:0/476546410 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f48c80418a0 con 0x7f48d410d990 2026-02-13T21:18:41.037 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.030+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d40f7b80 con 0x7f48d410d990 2026-02-13T21:18:41.037 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.030+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d4151e80 con 0x7f48d410d990 2026-02-13T21:18:41.038 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.031+0000 7f48c2ffd640 1 -- 10.20.193.12:0/476546410 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f48c8038470 con 0x7f48d410d990 2026-02-13T21:18:41.038 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.032+0000 7f48c2ffd640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48b00793f0 0x7f48b0099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:41.038 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.032+0000 7f48c2ffd640 1 -- 10.20.193.12:0/476546410 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6320+0+0 (secure 0 0 0) 0x7f48c803e070 con 0x7f48d410d990 2026-02-13T21:18:41.038 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.032+0000 7f48d9d50640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48b00793f0 0x7f48b0099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:41.038 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.032+0000 7f48d9d50640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48b00793f0 0x7f48b0099900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f48c4005fd0 tx=0x7f48c4005930 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:41.038 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.035+0000 7f48c2ffd640 1 -- 10.20.193.12:0/476546410 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f48c808e560 con 0x7f48d410d990 2026-02-13T21:18:41.169 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.165+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "foo"} v 0) -- 0x7f48d40f7e30 con 0x7f48d410d990 2026-02-13T21:18:41.170 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.166+0000 7f48c2ffd640 1 -- 10.20.193.12:0/476546410 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "foo"}]=0 foo marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 155+0+0 (secure 0 0 0) 0x7f48c8093660 con 0x7f48d410d990 2026-02-13T21:18:41.170 INFO:teuthology.orchestra.run.trial012.stderr:foo marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2026-02-13T21:18:41.172 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48b00793f0 msgr2=0x7f48b0099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:41.172 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48b00793f0 0x7f48b0099900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f48c4005fd0 tx=0x7f48c4005930 comp rx=0 tx=0).stop 2026-02-13T21:18:41.172 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 msgr2=0x7f48d40f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:41.172 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 0x7f48d40f6750 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009580 tx=0x7f48c8004290 comp rx=0 tx=0).stop 2026-02-13T21:18:41.172 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 shutdown_connections 2026-02-13T21:18:41.173 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f48b00793f0 0x7f48b0099900 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.173 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f48d410d990 0x7f48d40f6750 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.173 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 --2- 10.20.193.12:0/476546410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f48d410c860 0x7f48d40f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.173 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 >> 10.20.193.12:0/476546410 conn(0x7f48d40e9f00 msgr2=0x7f48d40ec3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:41.173 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 shutdown_connections 2026-02-13T21:18:41.173 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.168+0000 7f48dbfdb640 1 -- 10.20.193.12:0/476546410 wait complete. 2026-02-13T21:18:41.210 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph fs set foo refuse_client_session true' 2026-02-13T21:18:41.327 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:41.332 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012[37922]: 2026-02-13T21:18:41.165+0000 7efd402bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.446+0000 7f9e065fa640 1 -- 10.20.193.12:0/1829915417 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00054e20 msgr2=0x7f9e00108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.446+0000 7f9e065fa640 1 --2- 10.20.193.12:0/1829915417 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00054e20 0x7f9e00108fd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9dec005fd0 tx=0x7f9dec02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.446+0000 7f9e065fa640 1 -- 10.20.193.12:0/1829915417 shutdown_connections 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.446+0000 7f9e065fa640 1 --2- 10.20.193.12:0/1829915417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e00109510 0x7f9e00109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.446+0000 7f9e065fa640 1 --2- 10.20.193.12:0/1829915417 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00054e20 0x7f9e00108fd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.446+0000 7f9e065fa640 1 -- 10.20.193.12:0/1829915417 >> 10.20.193.12:0/1829915417 conn(0x7f9e000e6b40 msgr2=0x7f9e00106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.446+0000 7f9e065fa640 1 -- 10.20.193.12:0/1829915417 shutdown_connections 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.446+0000 7f9e065fa640 1 -- 10.20.193.12:0/1829915417 wait complete. 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9e065fa640 1 Processor -- start 2026-02-13T21:18:41.450 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9e065fa640 1 -- start start 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9e065fa640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e00054e20 0x7f9e000f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9e065fa640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00109510 0x7f9e000f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9e065fa640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9e00151670 con 0x7f9e00109510 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9e065fa640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001514f0 con 0x7f9e00054e20 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dff7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00109510 0x7f9e000f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dff7fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00109510 0x7f9e000f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:51016/0 (socket says 10.20.193.12:51016) 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dff7fe640 1 -- 10.20.193.12:0/3334157410 learned_addr learned my addr 10.20.193.12:0/3334157410 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dfffff640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e00054e20 0x7f9e000f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dff7fe640 1 -- 10.20.193.12:0/3334157410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e00054e20 msgr2=0x7f9e000f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dff7fe640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e00054e20 0x7f9e000f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dff7fe640 1 -- 10.20.193.12:0/3334157410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e000f4010 con 0x7f9e00109510 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dff7fe640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00109510 0x7f9e000f3420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9df000afd0 tx=0x7f9df000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dfd7fa640 1 -- 10.20.193.12:0/3334157410 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9df0013070 con 0x7f9e00109510 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e000f4300 con 0x7f9e00109510 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dfd7fa640 1 -- 10.20.193.12:0/3334157410 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f9df0004440 con 0x7f9e00109510 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9dfd7fa640 1 -- 10.20.193.12:0/3334157410 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9df0002da0 con 0x7f9e00109510 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.447+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e000f4910 con 0x7f9e00109510 2026-02-13T21:18:41.451 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.448+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e00108fb0 con 0x7f9e00109510 2026-02-13T21:18:41.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.449+0000 7f9dfd7fa640 1 -- 10.20.193.12:0/3334157410 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f9df00077a0 con 0x7f9e00109510 2026-02-13T21:18:41.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.449+0000 7f9dfd7fa640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9dd40793f0 0x7f9dd4099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:41.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.449+0000 7f9dfffff640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9dd40793f0 0x7f9dd4099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:41.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.449+0000 7f9dfd7fa640 1 -- 10.20.193.12:0/3334157410 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6406+0+0 (secure 0 0 0) 0x7f9df009cd40 con 0x7f9e00109510 2026-02-13T21:18:41.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.450+0000 7f9dfffff640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9dd40793f0 0x7f9dd4099900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9dec02f6e0 tx=0x7f9dec03a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:41.455 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.452+0000 7f9dfd7fa640 1 -- 10.20.193.12:0/3334157410 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f9df0069ad0 con 0x7f9e00109510 2026-02-13T21:18:41.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] up:active 2026-02-13T21:18:41.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: fsmap foo:1 {0=foo.trial090.ppgikq=up:active} 1 up:standby 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: fsmap foo:1 {0=foo.trial090.ppgikq=up:active} 1 up:standby 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/289246063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:41.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:41.524 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.524 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.524 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/476546410' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "foo"} : dispatch 2026-02-13T21:18:41.524 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-13T21:18:41.524 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:41.524 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/476546410' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "foo"}]': finished 2026-02-13T21:18:41.524 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: osdmap e52: 8 total, 8 up, 8 in 2026-02-13T21:18:41.524 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:41 trial090 ceph-mon[42877]: fsmap foo:0/1 1 up:standby, 1 failed 2026-02-13T21:18:41.588 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:41.585+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "foo", "var": "refuse_client_session", "val": "true"} v 0) -- 0x7f9e000f4c20 con 0x7f9e00109510 2026-02-13T21:18:41.588 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.90:6832/705792844,v1:10.20.193.90:6833/705792844] up:active 2026-02-13T21:18:41.588 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: fsmap foo:1 {0=foo.trial090.ppgikq=up:active} 1 up:standby 2026-02-13T21:18:41.588 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: fsmap foo:1 {0=foo.trial090.ppgikq=up:active} 1 up:standby 2026-02-13T21:18:41.588 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.588 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.588 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:41.588 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/289246063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/476546410' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "foo"} : dispatch 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/476546410' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "foo"}]': finished 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: osdmap e52: 8 total, 8 up, 8 in 2026-02-13T21:18:41.589 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:41 trial012 ceph-mon[37926]: fsmap foo:0/1 1 up:standby, 1 failed 2026-02-13T21:18:42.172 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.168+0000 7f9dfd7fa640 1 -- 10.20.193.12:0/3334157410 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "foo", "var": "refuse_client_session", "val": "true"}]=0 client(s) blocked from establishing new session(s) v8) ==== 169+0+0 (secure 0 0 0) 0x7f9df006ebd0 con 0x7f9e00109510 2026-02-13T21:18:42.172 INFO:teuthology.orchestra.run.trial012.stderr:client(s) blocked from establishing new session(s) 2026-02-13T21:18:42.178 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9dd40793f0 msgr2=0x7f9dd4099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:42.178 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9dd40793f0 0x7f9dd4099900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9dec02f6e0 tx=0x7f9dec03a040 comp rx=0 tx=0).stop 2026-02-13T21:18:42.178 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00109510 msgr2=0x7f9e000f3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:42.178 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00109510 0x7f9e000f3420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9df000afd0 tx=0x7f9df000cd60 comp rx=0 tx=0).stop 2026-02-13T21:18:42.178 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 shutdown_connections 2026-02-13T21:18:42.178 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f9dd40793f0 0x7f9dd4099900 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:42.178 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f9e00109510 0x7f9e000f3420 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:42.178 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 --2- 10.20.193.12:0/3334157410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e00054e20 0x7f9e000f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:42.179 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 >> 10.20.193.12:0/3334157410 conn(0x7f9e000e6b40 msgr2=0x7f9e000e90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:42.179 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 shutdown_connections 2026-02-13T21:18:42.179 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.173+0000 7f9e065fa640 1 -- 10.20.193.12:0/3334157410 wait complete. 2026-02-13T21:18:42.215 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph fs volume rename foo bar --yes-i-really-mean-it' 2026-02-13T21:18:42.333 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:42.447 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.443+0000 7fd46c9f8640 1 -- 10.20.193.12:0/3335798000 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410d9b0 msgr2=0x7fd46410ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:42.447 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.443+0000 7fd46c9f8640 1 --2- 10.20.193.12:0/3335798000 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410d9b0 0x7fd46410ddc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd450005fd0 tx=0x7fd45002f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:42.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.443+0000 7fd46c9f8640 1 -- 10.20.193.12:0/3335798000 shutdown_connections 2026-02-13T21:18:42.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.443+0000 7fd46c9f8640 1 --2- 10.20.193.12:0/3335798000 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410d9b0 0x7fd46410ddc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:42.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.443+0000 7fd46c9f8640 1 --2- 10.20.193.12:0/3335798000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd46410c880 0x7fd46410ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:42.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.443+0000 7fd46c9f8640 1 -- 10.20.193.12:0/3335798000 >> 10.20.193.12:0/3335798000 conn(0x7fd4640e9f40 msgr2=0x7fd46410a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:42.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.443+0000 7fd46c9f8640 1 -- 10.20.193.12:0/3335798000 shutdown_connections 2026-02-13T21:18:42.448 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.443+0000 7fd46c9f8640 1 -- 10.20.193.12:0/3335798000 wait complete. 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3334157410' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "foo", "var": "refuse_client_session", "val": "true"} : dispatch 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: pgmap v90: 65 pgs: 65 active+clean; 579 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 2.1 KiB/s wr, 4 op/s 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/3334157410' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "foo", "var": "refuse_client_session", "val": "true"}]': finished 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.90:6832/2554327466,v1:10.20.193.90:6833/2554327466] up:boot 2026-02-13T21:18:42.449 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: fsmap foo:0/1 2 up:standby, 1 failed 2026-02-13T21:18:42.450 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:42 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "foo.trial090.ppgikq"} : dispatch 2026-02-13T21:18:42.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46c9f8640 1 Processor -- start 2026-02-13T21:18:42.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46c9f8640 1 -- start start 2026-02-13T21:18:42.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46c9f8640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410c880 0x7fd4640f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:42.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46c9f8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd46410d9b0 0x7fd4640f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:42.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46c9f8640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4641516a0 con 0x7fd46410c880 2026-02-13T21:18:42.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46c9f8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd464151520 con 0x7fd46410d9b0 2026-02-13T21:18:42.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46a76d640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410c880 0x7fd4640f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:42.452 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46a76d640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410c880 0x7fd4640f61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:51032/0 (socket says 10.20.193.12:51032) 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46a76d640 1 -- 10.20.193.12:0/2268466016 learned_addr learned my addr 10.20.193.12:0/2268466016 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd469f6c640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd46410d9b0 0x7fd4640f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46a76d640 1 -- 10.20.193.12:0/2268466016 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd46410d9b0 msgr2=0x7fd4640f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46a76d640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd46410d9b0 0x7fd4640f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46a76d640 1 -- 10.20.193.12:0/2268466016 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4640f7410 con 0x7fd46410c880 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46a76d640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410c880 0x7fd4640f61b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00d8d0 tx=0x7fd45c00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd44f7fe640 1 -- 10.20.193.12:0/2268466016 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd45c014070 con 0x7fd46410c880 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd44f7fe640 1 -- 10.20.193.12:0/2268466016 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fd45c00bcd0 con 0x7fd46410c880 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd44f7fe640 1 -- 10.20.193.12:0/2268466016 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd45c002cc0 con 0x7fd46410c880 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.444+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4640f7700 con 0x7fd46410c880 2026-02-13T21:18:42.453 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.445+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4640f7d10 con 0x7fd46410c880 2026-02-13T21:18:42.454 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.445+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46410ccf0 con 0x7fd46410c880 2026-02-13T21:18:42.454 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.446+0000 7fd44f7fe640 1 -- 10.20.193.12:0/2268466016 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fd45c00b840 con 0x7fd46410c880 2026-02-13T21:18:42.454 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.446+0000 7fd44f7fe640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd4400793f0 0x7fd440099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:42.454 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.446+0000 7fd469f6c640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd4400793f0 0x7fd440099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:42.454 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.446+0000 7fd44f7fe640 1 -- 10.20.193.12:0/2268466016 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6406+0+0 (secure 0 0 0) 0x7fd45c09cbb0 con 0x7fd46410c880 2026-02-13T21:18:42.454 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.447+0000 7fd469f6c640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd4400793f0 0x7fd440099900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd450002400 tx=0x7fd45003a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:42.454 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.449+0000 7fd44f7fe640 1 -- 10.20.193.12:0/2268466016 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fd45c069940 con 0x7fd46410c880 2026-02-13T21:18:42.578 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:42.574+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "foo", "new_vol_name": "bar", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) -- 0x7fd4640ef0e0 con 0x7fd4400793f0 2026-02-13T21:18:42.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3334157410' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "foo", "var": "refuse_client_session", "val": "true"} : dispatch 2026-02-13T21:18:42.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: pgmap v90: 65 pgs: 65 active+clean; 579 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 2.1 KiB/s wr, 4 op/s 2026-02-13T21:18:42.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:42.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:42.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:42.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:42.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:42.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:42.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/3334157410' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "foo", "var": "refuse_client_session", "val": "true"}]': finished 2026-02-13T21:18:42.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.90:6832/2554327466,v1:10.20.193.90:6833/2554327466] up:boot 2026-02-13T21:18:42.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: fsmap foo:0/1 2 up:standby, 1 failed 2026-02-13T21:18:42.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:42 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "foo.trial090.ppgikq"} : dispatch 2026-02-13T21:18:43.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:43 trial012 ceph-mon[37926]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "fs volume rename", "vol_name": "foo", "new_vol_name": "bar", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:43.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:43.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:43 trial012 ceph-mon[37926]: Saving service mds.bar spec with placement count:2 2026-02-13T21:18:43.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:43.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "fs rename", "fs_name": "foo", "new_fs_name": "bar", "yes_i_really_mean_it": true} : dispatch 2026-02-13T21:18:43.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:43.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:43 trial012 ceph-mon[37926]: osdmap e53: 8 total, 8 up, 8 in 2026-02-13T21:18:43.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:43 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:43.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:43 trial090 ceph-mon[42877]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "fs volume rename", "vol_name": "foo", "new_vol_name": "bar", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T21:18:43.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:43.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:43 trial090 ceph-mon[42877]: Saving service mds.bar spec with placement count:2 2026-02-13T21:18:43.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:43.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "fs rename", "fs_name": "foo", "new_fs_name": "bar", "yes_i_really_mean_it": true} : dispatch 2026-02-13T21:18:43.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:43.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:43 trial090 ceph-mon[42877]: osdmap e53: 8 total, 8 up, 8 in 2026-02-13T21:18:43.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:43 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "fs rename", "fs_name": "foo", "new_fs_name": "bar", "yes_i_really_mean_it": true}]': finished 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.12:6834/3171735297,v1:10.20.193.12:6835/3171735297] up:standby 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: fsmap bar:0/1 2 up:standby, 1 failed 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool rename", "srcpool": "cephfs.foo.meta", "destpool": "cephfs.bar.meta"} : dispatch 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mds.bar.trial012.ffjxty", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial012.ffjxty", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: Deploying daemon mds.bar.trial012.ffjxty on trial012 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: pgmap v92: 65 pgs: 65 active+clean; 579 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 2.2 KiB/s wr, 4 op/s 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mds.bar.trial090.sdpumd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial090.sdpumd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T21:18:44.593 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:44 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:44.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "fs rename", "fs_name": "foo", "new_fs_name": "bar", "yes_i_really_mean_it": true}]': finished 2026-02-13T21:18:44.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.12:6834/3171735297,v1:10.20.193.12:6835/3171735297] up:standby 2026-02-13T21:18:44.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: fsmap bar:0/1 2 up:standby, 1 failed 2026-02-13T21:18:44.625 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool rename", "srcpool": "cephfs.foo.meta", "destpool": "cephfs.bar.meta"} : dispatch 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mds.bar.trial012.ffjxty", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial012.ffjxty", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: Deploying daemon mds.bar.trial012.ffjxty on trial012 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: pgmap v92: 65 pgs: 65 active+clean; 579 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail; 2.2 KiB/s wr, 4 op/s 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get-or-create", "entity": "mds.bar.trial090.sdpumd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial090.sdpumd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T21:18:44.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:44 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:45.353 INFO:teuthology.orchestra.run.trial012.stdout:FS volume 'foo' renamed to 'bar' 2026-02-13T21:18:45.354 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.349+0000 7fd44f7fe640 1 -- 10.20.193.12:0/2268466016 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7fd4640ef0e0 con 0x7fd4400793f0 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd4400793f0 msgr2=0x7fd440099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd4400793f0 0x7fd440099900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd450002400 tx=0x7fd45003a040 comp rx=0 tx=0).stop 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410c880 msgr2=0x7fd4640f61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410c880 0x7fd4640f61b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00d8d0 tx=0x7fd45c00dda0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 shutdown_connections 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd4400793f0 0x7fd440099900 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd46410d9b0 0x7fd4640f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 --2- 10.20.193.12:0/2268466016 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd46410c880 0x7fd4640f61b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.356 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 >> 10.20.193.12:0/2268466016 conn(0x7fd4640e9f40 msgr2=0x7fd4640ec490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:45.357 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 shutdown_connections 2026-02-13T21:18:45.357 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.352+0000 7fd46c9f8640 1 -- 10.20.193.12:0/2268466016 wait complete. 2026-02-13T21:18:45.413 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph fs set bar joinable true' 2026-02-13T21:18:45.519 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: Deploying daemon mds.bar.trial090.sdpumd on trial090 2026-02-13T21:18:45.520 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool rename", "srcpool": "cephfs.foo.meta", "destpool": "cephfs.bar.meta"}]': finished 2026-02-13T21:18:45.520 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: osdmap e54: 8 total, 8 up, 8 in 2026-02-13T21:18:45.520 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool rename", "srcpool": "cephfs.foo.data", "destpool": "cephfs.bar.data"} : dispatch 2026-02-13T21:18:45.520 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.12:6836/878511953,v1:10.20.193.12:6837/878511953] up:boot 2026-02-13T21:18:45.520 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: fsmap bar:0/1 3 up:standby, 1 failed 2026-02-13T21:18:45.520 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "bar.trial012.ffjxty"} : dispatch 2026-02-13T21:18:45.520 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.520 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.521 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.521 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.521 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.521 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:45 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: Deploying daemon mds.bar.trial090.sdpumd on trial090 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool rename", "srcpool": "cephfs.foo.meta", "destpool": "cephfs.bar.meta"}]': finished 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: osdmap e54: 8 total, 8 up, 8 in 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd pool rename", "srcpool": "cephfs.foo.data", "destpool": "cephfs.bar.data"} : dispatch 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.12:6836/878511953,v1:10.20.193.12:6837/878511953] up:boot 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: fsmap bar:0/1 3 up:standby, 1 failed 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "bar.trial012.ffjxty"} : dispatch 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.522 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:45.523 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:45 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:45.536 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.660+0000 7fd98e053640 1 -- 10.20.193.12:0/1629904022 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810b710 msgr2=0x7fd98810bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.660+0000 7fd98e053640 1 --2- 10.20.193.12:0/1629904022 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810b710 0x7fd98810bb20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd978005fd0 tx=0x7fd97802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.660+0000 7fd98e053640 1 -- 10.20.193.12:0/1629904022 shutdown_connections 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.660+0000 7fd98e053640 1 --2- 10.20.193.12:0/1629904022 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810b710 0x7fd98810bb20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.660+0000 7fd98e053640 1 --2- 10.20.193.12:0/1629904022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd98810a5e0 0x7fd98810aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.660+0000 7fd98e053640 1 -- 10.20.193.12:0/1629904022 >> 10.20.193.12:0/1629904022 conn(0x7fd9880e7cc0 msgr2=0x7fd988108130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.660+0000 7fd98e053640 1 -- 10.20.193.12:0/1629904022 shutdown_connections 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.660+0000 7fd98e053640 1 -- 10.20.193.12:0/1629904022 wait complete. 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd98e053640 1 Processor -- start 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd98e053640 1 -- start start 2026-02-13T21:18:45.665 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd98e053640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810a5e0 0x7fd9880f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd98e053640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd98810b710 0x7fd9880f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd98e053640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd98814f400 con 0x7fd98810a5e0 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd98e053640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd98814f280 con 0x7fd98810b710 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd9877fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810a5e0 0x7fd9880f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd9877fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810a5e0 0x7fd9880f62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:51076/0 (socket says 10.20.193.12:51076) 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd9877fe640 1 -- 10.20.193.12:0/824821195 learned_addr learned my addr 10.20.193.12:0/824821195 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd986ffd640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd98810b710 0x7fd9880f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd9877fe640 1 -- 10.20.193.12:0/824821195 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd98810b710 msgr2=0x7fd9880f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd9877fe640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd98810b710 0x7fd9880f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.661+0000 7fd9877fe640 1 -- 10.20.193.12:0/824821195 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9880f7540 con 0x7fd98810a5e0 2026-02-13T21:18:45.666 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.662+0000 7fd9877fe640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810a5e0 0x7fd9880f62e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd97400afd0 tx=0x7fd97400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:45.668 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.662+0000 7fd984ff9640 1 -- 10.20.193.12:0/824821195 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd974013070 con 0x7fd98810a5e0 2026-02-13T21:18:45.668 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.662+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9880f7830 con 0x7fd98810a5e0 2026-02-13T21:18:45.668 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.662+0000 7fd984ff9640 1 -- 10.20.193.12:0/824821195 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fd974004440 con 0x7fd98810a5e0 2026-02-13T21:18:45.668 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.662+0000 7fd984ff9640 1 -- 10.20.193.12:0/824821195 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd974002da0 con 0x7fd98810a5e0 2026-02-13T21:18:45.668 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.662+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9880f7e40 con 0x7fd98810a5e0 2026-02-13T21:18:45.668 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.662+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98814fbe0 con 0x7fd98810a5e0 2026-02-13T21:18:45.668 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.663+0000 7fd984ff9640 1 -- 10.20.193.12:0/824821195 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fd9740077a0 con 0x7fd98810a5e0 2026-02-13T21:18:45.669 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.664+0000 7fd984ff9640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd95c0793f0 0x7fd95c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:45.669 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.664+0000 7fd986ffd640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd95c0793f0 0x7fd95c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:45.669 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.664+0000 7fd984ff9640 1 -- 10.20.193.12:0/824821195 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6406+0+0 (secure 0 0 0) 0x7fd97409cc50 con 0x7fd98810a5e0 2026-02-13T21:18:45.669 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.664+0000 7fd986ffd640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd95c0793f0 0x7fd95c099900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd97802f6e0 tx=0x7fd978031040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:45.670 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.667+0000 7fd984ff9640 1 -- 10.20.193.12:0/824821195 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fd9740699e0 con 0x7fd98810a5e0 2026-02-13T21:18:45.805 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.802+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "bar", "var": "joinable", "val": "true"} v 0) -- 0x7fd98810aa50 con 0x7fd98810a5e0 2026-02-13T21:18:45.809 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.806+0000 7fd984ff9640 1 -- 10.20.193.12:0/824821195 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "bar", "var": "joinable", "val": "true"}]=0 bar marked joinable; MDS may join as newly active. v12) ==== 156+0+0 (secure 0 0 0) 0x7fd97406eae0 con 0x7fd98810a5e0 2026-02-13T21:18:45.809 INFO:teuthology.orchestra.run.trial012.stderr:bar marked joinable; MDS may join as newly active. 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.808+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd95c0793f0 msgr2=0x7fd95c099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.808+0000 7fd98e053640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd95c0793f0 0x7fd95c099900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd97802f6e0 tx=0x7fd978031040 comp rx=0 tx=0).stop 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810a5e0 msgr2=0x7fd9880f62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810a5e0 0x7fd9880f62e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd97400afd0 tx=0x7fd97400cd60 comp rx=0 tx=0).stop 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 shutdown_connections 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fd95c0793f0 0x7fd95c099900 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd98810b710 0x7fd9880f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 --2- 10.20.193.12:0/824821195 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fd98810a5e0 0x7fd9880f62e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 >> 10.20.193.12:0/824821195 conn(0x7fd9880e7cc0 msgr2=0x7fd98805e720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 shutdown_connections 2026-02-13T21:18:45.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:45.809+0000 7fd98e053640 1 -- 10.20.193.12:0/824821195 wait complete. 2026-02-13T21:18:45.853 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'ceph fs set bar refuse_client_session false' 2026-02-13T21:18:45.972 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:46.104 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.099+0000 7f109137d640 1 -- 10.20.193.12:0/3943909271 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10c880 msgr2=0x7f108c10ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.099+0000 7f109137d640 1 --2- 10.20.193.12:0/3943909271 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10c880 0x7f108c10ccf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1074005fd0 tx=0x7f107402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.099+0000 7f109137d640 1 -- 10.20.193.12:0/3943909271 shutdown_connections 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.099+0000 7f109137d640 1 --2- 10.20.193.12:0/3943909271 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f108c10d9b0 0x7f108c10ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.099+0000 7f109137d640 1 --2- 10.20.193.12:0/3943909271 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10c880 0x7f108c10ccf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.099+0000 7f109137d640 1 -- 10.20.193.12:0/3943909271 >> 10.20.193.12:0/3943909271 conn(0x7f108c0e9f40 msgr2=0x7f108c10a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.099+0000 7f109137d640 1 -- 10.20.193.12:0/3943909271 shutdown_connections 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.099+0000 7f109137d640 1 -- 10.20.193.12:0/3943909271 wait complete. 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f109137d640 1 Processor -- start 2026-02-13T21:18:46.105 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f109137d640 1 -- start start 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f109137d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f108c10c880 0x7f108c0f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f109137d640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10d9b0 0x7f108c0f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f109137d640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f108c151690 con 0x7f108c10d9b0 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f109137d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f108c151510 con 0x7f108c10c880 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f108a7fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10d9b0 0x7f108c0f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f108a7fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10d9b0 0x7f108c0f6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:51088/0 (socket says 10.20.193.12:51088) 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f108a7fc640 1 -- 10.20.193.12:0/713498148 learned_addr learned my addr 10.20.193.12:0/713498148 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f108affd640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f108c10c880 0x7f108c0f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f108a7fc640 1 -- 10.20.193.12:0/713498148 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f108c10c880 msgr2=0x7f108c0f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f108a7fc640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f108c10c880 0x7f108c0f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f108a7fc640 1 -- 10.20.193.12:0/713498148 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c0f7420 con 0x7f108c10d9b0 2026-02-13T21:18:46.106 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.100+0000 7f108a7fc640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10d9b0 0x7f108c0f6830 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f107800d8d0 tx=0x7f107800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:46.107 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.101+0000 7f1083fff640 1 -- 10.20.193.12:0/713498148 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1078014070 con 0x7f108c10d9b0 2026-02-13T21:18:46.107 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.101+0000 7f1083fff640 1 -- 10.20.193.12:0/713498148 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f107800bcd0 con 0x7f108c10d9b0 2026-02-13T21:18:46.107 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.101+0000 7f1083fff640 1 -- 10.20.193.12:0/713498148 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1078002cc0 con 0x7f108c10d9b0 2026-02-13T21:18:46.107 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.101+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c0f7710 con 0x7f108c10d9b0 2026-02-13T21:18:46.107 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.101+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c0f7d20 con 0x7f108c10d9b0 2026-02-13T21:18:46.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.101+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108c10ddc0 con 0x7f108c10d9b0 2026-02-13T21:18:46.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.102+0000 7f1083fff640 1 -- 10.20.193.12:0/713498148 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f107800b840 con 0x7f108c10d9b0 2026-02-13T21:18:46.108 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.102+0000 7f1083fff640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f105c0794c0 0x7f105c0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:46.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.103+0000 7f1083fff640 1 -- 10.20.193.12:0/713498148 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6406+0+0 (secure 0 0 0) 0x7f107809caf0 con 0x7f108c10d9b0 2026-02-13T21:18:46.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.103+0000 7f108affd640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f105c0794c0 0x7f105c0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:46.109 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.103+0000 7f108affd640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f105c0794c0 0x7f105c0999d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1074002400 tx=0x7f107403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:46.111 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.107+0000 7f1083fff640 1 -- 10.20.193.12:0/713498148 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f1078069880 con 0x7f108c10d9b0 2026-02-13T21:18:46.246 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.242+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "bar", "var": "refuse_client_session", "val": "false"} v 0) -- 0x7f108c0f7fd0 con 0x7f108c10d9b0 2026-02-13T21:18:46.369 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.366+0000 7f1083fff640 1 -- 10.20.193.12:0/713498148 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "bar", "var": "refuse_client_session", "val": "false"}]=0 client(s) allowed to establish new session(s) v13) ==== 165+0+0 (secure 0 0 0) 0x7f107806e980 con 0x7f108c10d9b0 2026-02-13T21:18:46.369 INFO:teuthology.orchestra.run.trial012.stderr:client(s) allowed to establish new session(s) 2026-02-13T21:18:46.372 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f105c0794c0 msgr2=0x7f105c0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:46.372 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f105c0794c0 0x7f105c0999d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1074002400 tx=0x7f107403a040 comp rx=0 tx=0).stop 2026-02-13T21:18:46.372 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10d9b0 msgr2=0x7f108c0f6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:46.372 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10d9b0 0x7f108c0f6830 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f107800d8d0 tx=0x7f107800dda0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.372 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 shutdown_connections 2026-02-13T21:18:46.373 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f105c0794c0 0x7f105c0999d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.373 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f108c10d9b0 0x7f108c0f6830 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.373 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 --2- 10.20.193.12:0/713498148 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f108c10c880 0x7f108c0f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.373 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 >> 10.20.193.12:0/713498148 conn(0x7f108c0e9f40 msgr2=0x7f108c0ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:46.373 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 shutdown_connections 2026-02-13T21:18:46.373 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.369+0000 7f109137d640 1 -- 10.20.193.12:0/713498148 wait complete. 2026-02-13T21:18:46.412 INFO:teuthology.run_tasks:Running task fs.ready... 2026-02-13T21:18:46.428 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T21:18:46.552 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:46.626 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool rename", "srcpool": "cephfs.foo.data", "destpool": "cephfs.bar.data"}]': finished 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: osdmap e55: 8 total, 8 up, 8 in 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: Remove service mds.foo 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] up:boot 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.90:6832/2554327466,v1:10.20.193.90:6833/2554327466] up:standby 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: fsmap bar:0/1 4 up:standby, 1 failed 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "bar.trial090.sdpumd"} : dispatch 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: pgmap v95: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 KiB/s wr, 6 op/s 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.627 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/824821195' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "bar", "var": "joinable", "val": "true"} : dispatch 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: Standby daemon mds.foo.trial012.ebqplc assigned to filesystem bar as rank 0 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/824821195' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "bar", "var": "joinable", "val": "true"}]': finished 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: fsmap bar:1/1 {0=foo.trial012.ebqplc=up:replay} 3 up:standby 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:46.628 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/713498148' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "bar", "var": "refuse_client_session", "val": "false"} : dispatch 2026-02-13T21:18:46.629 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:46 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial012[37922]: 2026-02-13T21:18:46.365+0000 7efd402bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/3737632879 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f3810cc80 msgr2=0x7f8f3810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 --2- 10.20.193.12:0/3737632879 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f3810cc80 0x7f8f3810d090 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005fd0 tx=0x7f8f2c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/3737632879 shutdown_connections 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 --2- 10.20.193.12:0/3737632879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f381125c0 0x7f8f381129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 --2- 10.20.193.12:0/3737632879 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f3810cc80 0x7f8f3810d090 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/3737632879 >> 10.20.193.12:0/3737632879 conn(0x7f8f380ea4b0 msgr2=0x7f8f3810a900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/3737632879 shutdown_connections 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/3737632879 wait complete. 2026-02-13T21:18:46.751 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 Processor -- start 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.747+0000 7f8f3ccc5640 1 -- start start 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f3ccc5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f3810cc80 0x7f8f3811ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f3ccc5640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f381125c0 0x7f8f3811b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f3ccc5640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38155da0 con 0x7f8f381125c0 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f3ccc5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38155c20 con 0x7f8f3810cc80 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f35d74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f381125c0 0x7f8f3811b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f35d74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f381125c0 0x7f8f3811b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:51118/0 (socket says 10.20.193.12:51118) 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f35d74640 1 -- 10.20.193.12:0/2587868411 learned_addr learned my addr 10.20.193.12:0/2587868411 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f35d74640 1 -- 10.20.193.12:0/2587868411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f3810cc80 msgr2=0x7f8f3811ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f35d74640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f3810cc80 0x7f8f3811ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f35d74640 1 -- 10.20.193.12:0/2587868411 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f381205e0 con 0x7f8f381125c0 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f35d74640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f381125c0 0x7f8f3811b320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000d6a0 tx=0x7f8f2000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f1f7fe640 1 -- 10.20.193.12:0/2587868411 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8f20014070 con 0x7f8f381125c0 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f1f7fe640 1 -- 10.20.193.12:0/2587868411 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f8f2000b840 con 0x7f8f381125c0 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f1f7fe640 1 -- 10.20.193.12:0/2587868411 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8f20002bc0 con 0x7f8f381125c0 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f381208d0 con 0x7f8f381125c0 2026-02-13T21:18:46.752 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f38120ee0 con 0x7f8f381125c0 2026-02-13T21:18:46.753 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.748+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3810df00 con 0x7f8f381125c0 2026-02-13T21:18:46.753 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.749+0000 7f8f1f7fe640 1 -- 10.20.193.12:0/2587868411 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f8f20004290 con 0x7f8f381125c0 2026-02-13T21:18:46.753 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.750+0000 7f8f1f7fe640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8f100794c0 0x7f8f100999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:46.753 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.750+0000 7f8f36575640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8f100794c0 0x7f8f100999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:46.753 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.750+0000 7f8f1f7fe640 1 -- 10.20.193.12:0/2587868411 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6492+0+0 (secure 0 0 0) 0x7f8f2009cad0 con 0x7f8f381125c0 2026-02-13T21:18:46.753 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.750+0000 7f8f36575640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8f100794c0 0x7f8f100999d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f38121670 tx=0x7f8f2c005930 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:46.755 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.752+0000 7f8f1f7fe640 1 -- 10.20.193.12:0/2587868411 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f8f20069810 con 0x7f8f381125c0 2026-02-13T21:18:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "osd pool rename", "srcpool": "cephfs.foo.data", "destpool": "cephfs.bar.data"}]': finished 2026-02-13T21:18:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: osdmap e55: 8 total, 8 up, 8 in 2026-02-13T21:18:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: Remove service mds.foo 2026-02-13T21:18:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] up:boot 2026-02-13T21:18:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.90:6832/2554327466,v1:10.20.193.90:6833/2554327466] up:standby 2026-02-13T21:18:46.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: fsmap bar:0/1 4 up:standby, 1 failed 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "mds metadata", "who": "bar.trial090.sdpumd"} : dispatch 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: pgmap v95: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 1.3 KiB/s wr, 6 op/s 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/824821195' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "bar", "var": "joinable", "val": "true"} : dispatch 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: Standby daemon mds.foo.trial012.ebqplc assigned to filesystem bar as rank 0 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/824821195' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "bar", "var": "joinable", "val": "true"}]': finished 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: fsmap bar:1/1 {0=foo.trial012.ebqplc=up:replay} 3 up:standby 2026-02-13T21:18:46.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:46.774 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:46 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/713498148' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "bar", "var": "refuse_client_session", "val": "false"} : dispatch 2026-02-13T21:18:46.887 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.884+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f3810d090 con 0x7f8f381125c0 2026-02-13T21:18:46.887 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.885+0000 7f8f1f7fe640 1 -- 10.20.193.12:0/2587868411 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+4445 (secure 0 0 0) 0x7f8f2006e910 con 0x7f8f381125c0 2026-02-13T21:18:46.888 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:46.888 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":14,"btime":"2026-02-13T21:18:46:369512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"bar.trial012.ffjxty","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.12:6837/878511953","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6836","nonce":878511953},{"type":"v1","addr":"10.20.193.12:6837","nonce":878511953}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24423,"name":"foo.trial090.ppgikq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"10.20.193.90:6833/2554327466","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":2554327466},{"type":"v1","addr":"10.20.193.90:6833","nonce":2554327466}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T21:18:36.309326+0000","modified":"2026-02-13T21:18:46.369507+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24435":{"gid":24435,"name":"bar.trial090.sdpumd","rank":0,"incarnation":14,"state":"up:replay","state_seq":1,"addr":"10.20.193.90:6835/1007071272","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1007071272},{"type":"v1","addr":"10.20.193.90:6835","nonce":1007071272}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2026-02-13T21:18:46.889 INFO:teuthology.orchestra.run.trial012.stderr:dumped fsmap epoch 14 2026-02-13T21:18:46.889 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8f100794c0 msgr2=0x7f8f100999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:46.889 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8f100794c0 0x7f8f100999d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f38121670 tx=0x7f8f2c005930 comp rx=0 tx=0).stop 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f381125c0 msgr2=0x7f8f3811b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f381125c0 0x7f8f3811b320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000d6a0 tx=0x7f8f2000db70 comp rx=0 tx=0).stop 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 shutdown_connections 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f8f100794c0 0x7f8f100999d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f8f381125c0 0x7f8f3811b320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 --2- 10.20.193.12:0/2587868411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f3810cc80 0x7f8f3811ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 >> 10.20.193.12:0/2587868411 conn(0x7f8f380ea4b0 msgr2=0x7f8f38110650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 shutdown_connections 2026-02-13T21:18:46.890 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:46.886+0000 7f8f3ccc5640 1 -- 10.20.193.12:0/2587868411 wait complete. 2026-02-13T21:18:46.927 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T21:18:47.048 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:47.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.156+0000 7f5941a20640 1 -- 10.20.193.12:0/1205469109 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 msgr2=0x7f593c152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:47.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.156+0000 7f5941a20640 1 --2- 10.20.193.12:0/1205469109 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 0x7f593c152c30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5924009930 tx=0x7f592402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.156+0000 7f5941a20640 1 -- 10.20.193.12:0/1205469109 shutdown_connections 2026-02-13T21:18:47.161 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.156+0000 7f5941a20640 1 --2- 10.20.193.12:0/1205469109 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 0x7f593c152c30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.156+0000 7f5941a20640 1 --2- 10.20.193.12:0/1205469109 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f593c109440 0x7f593c109850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.156+0000 7f5941a20640 1 -- 10.20.193.12:0/1205469109 >> 10.20.193.12:0/1205469109 conn(0x7f593c0e7050 msgr2=0x7f593c1074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.156+0000 7f5941a20640 1 -- 10.20.193.12:0/1205469109 shutdown_connections 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.156+0000 7f5941a20640 1 -- 10.20.193.12:0/1205469109 wait complete. 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f5941a20640 1 Processor -- start 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f5941a20640 1 -- start start 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f5941a20640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f593c109440 0x7f593c0f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f5941a20640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 0x7f593c0f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f5941a20640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f593c155d70 con 0x7f593c109d90 2026-02-13T21:18:47.162 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f5941a20640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f593c155bf0 con 0x7f593c109440 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f593a7fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 0x7f593c0f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f593a7fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 0x7f593c0f3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:51128/0 (socket says 10.20.193.12:51128) 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f593a7fc640 1 -- 10.20.193.12:0/2127928634 learned_addr learned my addr 10.20.193.12:0/2127928634 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f593affd640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f593c109440 0x7f593c0f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f593a7fc640 1 -- 10.20.193.12:0/2127928634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f593c109440 msgr2=0x7f593c0f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f593a7fc640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f593c109440 0x7f593c0f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f593a7fc640 1 -- 10.20.193.12:0/2127928634 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c0f9160 con 0x7f593c109d90 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f593a7fc640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 0x7f593c0f3ea0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5924009900 tx=0x7f5924002c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f5940a1e640 1 -- 10.20.193.12:0/2127928634 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5924046070 con 0x7f593c109d90 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.157+0000 7f5940a1e640 1 -- 10.20.193.12:0/2127928634 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f5924004420 con 0x7f593c109d90 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.158+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c0f93f0 con 0x7f593c109d90 2026-02-13T21:18:47.163 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.158+0000 7f5940a1e640 1 -- 10.20.193.12:0/2127928634 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5924041630 con 0x7f593c109d90 2026-02-13T21:18:47.164 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.158+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c0f99a0 con 0x7f593c109d90 2026-02-13T21:18:47.164 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.158+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c054b30 con 0x7f593c109d90 2026-02-13T21:18:47.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.159+0000 7f5940a1e640 1 -- 10.20.193.12:0/2127928634 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f5924038470 con 0x7f593c109d90 2026-02-13T21:18:47.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.160+0000 7f5940a1e640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59100793f0 0x7f5910099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:47.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.160+0000 7f593affd640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59100793f0 0x7f5910099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:47.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.160+0000 7f5940a1e640 1 -- 10.20.193.12:0/2127928634 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6492+0+0 (secure 0 0 0) 0x7f592403e070 con 0x7f593c109d90 2026-02-13T21:18:47.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.160+0000 7f593affd640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59100793f0 0x7f5910099900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f593c0fa1f0 tx=0x7f5930009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:47.165 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.163+0000 7f5940a1e640 1 -- 10.20.193.12:0/2127928634 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f592408e190 con 0x7f593c109d90 2026-02-13T21:18:47.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.301+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f593c0f9c50 con 0x7f593c109d90 2026-02-13T21:18:47.303 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.301+0000 7f5940a1e640 1 -- 10.20.193.12:0/2127928634 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+4445 (secure 0 0 0) 0x7f5924093290 con 0x7f593c109d90 2026-02-13T21:18:47.303 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:47.303 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":14,"btime":"2026-02-13T21:18:46:369512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"bar.trial012.ffjxty","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.12:6837/878511953","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6836","nonce":878511953},{"type":"v1","addr":"10.20.193.12:6837","nonce":878511953}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24423,"name":"foo.trial090.ppgikq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"10.20.193.90:6833/2554327466","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":2554327466},{"type":"v1","addr":"10.20.193.90:6833","nonce":2554327466}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T21:18:36.309326+0000","modified":"2026-02-13T21:18:46.369507+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24435":{"gid":24435,"name":"bar.trial090.sdpumd","rank":0,"incarnation":14,"state":"up:replay","state_seq":1,"addr":"10.20.193.90:6835/1007071272","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1007071272},{"type":"v1","addr":"10.20.193.90:6835","nonce":1007071272}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2026-02-13T21:18:47.304 INFO:teuthology.orchestra.run.trial012.stderr:dumped fsmap epoch 14 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59100793f0 msgr2=0x7f5910099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59100793f0 0x7f5910099900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f593c0fa1f0 tx=0x7f5930009260 comp rx=0 tx=0).stop 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 msgr2=0x7f593c0f3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 0x7f593c0f3ea0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5924009900 tx=0x7f5924002c70 comp rx=0 tx=0).stop 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 shutdown_connections 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f59100793f0 0x7f5910099900 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f593c109d90 0x7f593c0f3ea0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 --2- 10.20.193.12:0/2127928634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f593c109440 0x7f593c0f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 >> 10.20.193.12:0/2127928634 conn(0x7f593c0e7050 msgr2=0x7f593c0edef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 shutdown_connections 2026-02-13T21:18:47.306 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.304+0000 7f5941a20640 1 -- 10.20.193.12:0/2127928634 wait complete. 2026-02-13T21:18:47.345 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T21:18:47.468 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:47.582 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.580+0000 7fcc5a126640 1 -- 10.20.193.12:0/1350358429 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 msgr2=0x7fcc54109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:47.582 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.580+0000 7fcc5a126640 1 --2- 10.20.193.12:0/1350358429 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 0x7fcc54109ce0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcc40005fd0 tx=0x7fcc4002f1f0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.580+0000 7fcc5a126640 1 -- 10.20.193.12:0/1350358429 shutdown_connections 2026-02-13T21:18:47.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.580+0000 7fcc5a126640 1 --2- 10.20.193.12:0/1350358429 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc5410f210 0x7fcc5410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.580+0000 7fcc5a126640 1 --2- 10.20.193.12:0/1350358429 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 0x7fcc54109ce0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.580+0000 7fcc5a126640 1 -- 10.20.193.12:0/1350358429 >> 10.20.193.12:0/1350358429 conn(0x7fcc540e7050 msgr2=0x7fcc541074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:47.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.580+0000 7fcc5a126640 1 -- 10.20.193.12:0/1350358429 shutdown_connections 2026-02-13T21:18:47.583 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.580+0000 7fcc5a126640 1 -- 10.20.193.12:0/1350358429 wait complete. 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: Removing orphan daemon mds.foo.trial012.ebqplc... 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: Removing daemon mds.foo.trial012.ebqplc from trial012 -- ports [] 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/713498148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "bar", "var": "refuse_client_session", "val": "false"}]': finished 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: osdmap e56: 8 total, 8 up, 8 in 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.12:6834/3171735297,v1:10.20.193.12:6835/3171735297] up:reconnect 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: Standby daemon mds.bar.trial090.sdpumd assigned to filesystem bar as rank 0 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: fsmap bar:0/1 3 up:standby, 1 failed 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: fsmap bar:1/1 {0=bar.trial090.sdpumd=up:replay} 2 up:standby 2026-02-13T21:18:47.583 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: Removing key for mds.foo.trial012.ebqplc 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth rm", "entity": "mds.foo.trial012.ebqplc"} : dispatch 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth rm", "entity": "mds.foo.trial012.ebqplc"}]': finished 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: Removing orphan daemon mds.foo.trial090.ppgikq... 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: Removing daemon mds.foo.trial090.ppgikq from trial090 -- ports [] 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2587868411' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth rm", "entity": "mds.foo.trial090.ppgikq"} : dispatch 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth rm", "entity": "mds.foo.trial090.ppgikq"}]': finished 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: osdmap e57: 8 total, 8 up, 8 in 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "mds.foo", "name": "mds_join_fs"} : dispatch 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "config rm", "who": "mds.foo", "name": "mds_join_fs"}]': finished 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config-key del","key":"mgr/cephadm/spec.mds.foo"} : dispatch 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/spec.mds.foo"}]': finished 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:47.584 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:47 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2127928634' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc5a126640 1 Processor -- start 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc5a126640 1 -- start start 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc5a126640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 0x7fcc540f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc5a126640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc5410f210 0x7fcc540f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc5a126640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54152a50 con 0x7fcc541098d0 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc5a126640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc541528d0 con 0x7fcc5410f210 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc537fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 0x7fcc540f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc537fe640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 0x7fcc540f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:51154/0 (socket says 10.20.193.12:51154) 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc537fe640 1 -- 10.20.193.12:0/1098792999 learned_addr learned my addr 10.20.193.12:0/1098792999 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc52ffd640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc5410f210 0x7fcc540f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc537fe640 1 -- 10.20.193.12:0/1098792999 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc5410f210 msgr2=0x7fcc540f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:47.585 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc537fe640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc5410f210 0x7fcc540f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.581+0000 7fcc537fe640 1 -- 10.20.193.12:0/1098792999 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc540f21d0 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.582+0000 7fcc537fe640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 0x7fcc540f1590 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcc40005fa0 tx=0x7fcc40002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.582+0000 7fcc50ff9640 1 -- 10.20.193.12:0/1098792999 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcc40046070 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.582+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc540f6e90 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.582+0000 7fcc50ff9640 1 -- 10.20.193.12:0/1098792999 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fcc400054e0 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.582+0000 7fcc50ff9640 1 -- 10.20.193.12:0/1098792999 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcc40004df0 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.582+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc540f7410 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.582+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5410ab50 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.583+0000 7fcc50ff9640 1 -- 10.20.193.12:0/1098792999 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fcc40005050 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.584+0000 7fcc50ff9640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc280793f0 0x7fcc28099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.584+0000 7fcc52ffd640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc280793f0 0x7fcc28099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.584+0000 7fcc50ff9640 1 -- 10.20.193.12:0/1098792999 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6492+0+0 (secure 0 0 0) 0x7fcc4003e070 con 0x7fcc541098d0 2026-02-13T21:18:47.586 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.584+0000 7fcc52ffd640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc280793f0 0x7fcc28099900 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc5410c370 tx=0x7fcc44009210 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:47.588 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.586+0000 7fcc50ff9640 1 -- 10.20.193.12:0/1098792999 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fcc4008e520 con 0x7fcc541098d0 2026-02-13T21:18:47.701 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.699+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc540f7790 con 0x7fcc541098d0 2026-02-13T21:18:47.702 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.699+0000 7fcc50ff9640 1 -- 10.20.193.12:0/1098792999 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17906 (secure 0 0 0) 0x7fcc40093620 con 0x7fcc541098d0 2026-02-13T21:18:47.702 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:47.702 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":57,"fsid":"3551db35-0921-11f1-800a-d404e6e7d460","created":"2026-02-13T21:16:19.758726+0000","modified":"2026-02-13T21:18:46.919870+0000","last_up_change":"2026-02-13T21:18:24.265543+0000","last_in_change":"2026-02-13T21:18:15.652245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T21:17:45.821822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.bar.meta","create_time":"2026-02-13T21:18:34.434230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.bar.data","create_time":"2026-02-13T21:18:35.310732+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"cephfs":{"data":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de74b69e-730a-4162-a3cc-3daa616bf84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6802","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6803","nonce":1211901108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6804","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6805","nonce":1211901108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6808","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6809","nonce":1211901108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6806","nonce":1211901108},{"type":"v1","addr":"10.20.193.12:6807","nonce":1211901108}]},"public_addr":"10.20.193.12:6803/1211901108","cluster_addr":"10.20.193.12:6805/1211901108","heartbeat_back_addr":"10.20.193.12:6809/1211901108","heartbeat_front_addr":"10.20.193.12:6807/1211901108","state":["exists","up"]},{"osd":1,"uuid":"6118d6e3-09c9-4db8-b217-1c3327e2ea30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6810","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6811","nonce":2390579753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6812","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6813","nonce":2390579753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6816","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6817","nonce":2390579753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6814","nonce":2390579753},{"type":"v1","addr":"10.20.193.12:6815","nonce":2390579753}]},"public_addr":"10.20.193.12:6811/2390579753","cluster_addr":"10.20.193.12:6813/2390579753","heartbeat_back_addr":"10.20.193.12:6817/2390579753","heartbeat_front_addr":"10.20.193.12:6815/2390579753","state":["exists","up"]},{"osd":2,"uuid":"752d80ce-ee90-4e8a-9ccb-626e1ff2ce72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6818","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6819","nonce":1263676438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6820","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6821","nonce":1263676438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6824","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6825","nonce":1263676438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6822","nonce":1263676438},{"type":"v1","addr":"10.20.193.12:6823","nonce":1263676438}]},"public_addr":"10.20.193.12:6819/1263676438","cluster_addr":"10.20.193.12:6821/1263676438","heartbeat_back_addr":"10.20.193.12:6825/1263676438","heartbeat_front_addr":"10.20.193.12:6823/1263676438","state":["exists","up"]},{"osd":3,"uuid":"2e4c26bc-c190-453c-bd22-452337fb54fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6826","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6827","nonce":1782630321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6828","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6829","nonce":1782630321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6832","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6833","nonce":1782630321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6830","nonce":1782630321},{"type":"v1","addr":"10.20.193.12:6831","nonce":1782630321}]},"public_addr":"10.20.193.12:6827/1782630321","cluster_addr":"10.20.193.12:6829/1782630321","heartbeat_back_addr":"10.20.193.12:6833/1782630321","heartbeat_front_addr":"10.20.193.12:6831/1782630321","state":["exists","up"]},{"osd":4,"uuid":"2a92779e-4460-41dc-b18a-4c646ac46091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6801","nonce":1546978354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6803","nonce":1546978354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6807","nonce":1546978354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":1546978354},{"type":"v1","addr":"10.20.193.90:6805","nonce":1546978354}]},"public_addr":"10.20.193.90:6801/1546978354","cluster_addr":"10.20.193.90:6803/1546978354","heartbeat_back_addr":"10.20.193.90:6807/1546978354","heartbeat_front_addr":"10.20.193.90:6805/1546978354","state":["exists","up"]},{"osd":5,"uuid":"40f7e047-3d3d-4bd2-9964-d29a3ff11482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6809","nonce":2430801346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6811","nonce":2430801346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6815","nonce":2430801346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":2430801346},{"type":"v1","addr":"10.20.193.90:6813","nonce":2430801346}]},"public_addr":"10.20.193.90:6809/2430801346","cluster_addr":"10.20.193.90:6811/2430801346","heartbeat_back_addr":"10.20.193.90:6815/2430801346","heartbeat_front_addr":"10.20.193.90:6813/2430801346","state":["exists","up"]},{"osd":6,"uuid":"5837ab08-fa7e-4cc5-bb99-8c046a23cb8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6817","nonce":391511610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6819","nonce":391511610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6823","nonce":391511610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":391511610},{"type":"v1","addr":"10.20.193.90:6821","nonce":391511610}]},"public_addr":"10.20.193.90:6817/391511610","cluster_addr":"10.20.193.90:6819/391511610","heartbeat_back_addr":"10.20.193.90:6823/391511610","heartbeat_front_addr":"10.20.193.90:6821/391511610","state":["exists","up"]},{"osd":7,"uuid":"3a9be97d-270f-4370-bb57-9a4510f4e7f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6825","nonce":1694034982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6827","nonce":1694034982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6831","nonce":1694034982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":1694034982},{"type":"v1","addr":"10.20.193.90:6829","nonce":1694034982}]},"public_addr":"10.20.193.90:6825/1694034982","cluster_addr":"10.20.193.90:6827/1694034982","heartbeat_back_addr":"10.20.193.90:6831/1694034982","heartbeat_front_addr":"10.20.193.90:6829/1694034982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:28.184825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:35.247079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:42.366420+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:49.338130+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:17:57.851801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:06.994774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:13.782179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T21:18:22.858730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.12:6835/3171735297":"2026-02-14T21:18:46.365608+0000","10.20.193.90:6833/705792844":"2026-02-14T21:18:41.167329+0000","10.20.193.12:6834/3171735297":"2026-02-14T21:18:46.365608+0000","10.20.193.12:0/1300378024":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/3296163882":"2026-02-14T21:16:29.875530+0000","10.20.193.90:6832/705792844":"2026-02-14T21:18:41.167329+0000","10.20.193.12:6801/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/172285562":"2026-02-14T21:16:29.875530+0000","10.20.193.12:6800/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3542302382":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3023738569":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/72325951":"2026-02-14T21:16:29.875530+0000","10.20.193.12:0/3948096534":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6801/3481816594":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2322493062":"2026-02-14T21:17:01.611190+0000","10.20.193.12:0/2357723980":"2026-02-14T21:16:41.158196+0000","10.20.193.12:6800/1670149964":"2026-02-14T21:16:41.158196+0000","10.20.193.12:0/3800148741":"2026-02-14T21:17:01.611190+0000","10.20.193.12:6800/3481816594":"2026-02-14T21:17:01.611190+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T21:18:47.704 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc280793f0 msgr2=0x7fcc28099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:47.704 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc280793f0 0x7fcc28099900 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc5410c370 tx=0x7fcc44009210 comp rx=0 tx=0).stop 2026-02-13T21:18:47.704 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 msgr2=0x7fcc540f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:47.704 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 0x7fcc540f1590 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcc40005fa0 tx=0x7fcc40002900 comp rx=0 tx=0).stop 2026-02-13T21:18:47.705 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 shutdown_connections 2026-02-13T21:18:47.705 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fcc280793f0 0x7fcc28099900 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.705 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc5410f210 0x7fcc540f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.705 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 --2- 10.20.193.12:0/1098792999 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fcc541098d0 0x7fcc540f1590 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:47.705 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 >> 10.20.193.12:0/1098792999 conn(0x7fcc540e7050 msgr2=0x7fcc5410d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:47.705 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 shutdown_connections 2026-02-13T21:18:47.705 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:47.702+0000 7fcc5a126640 1 -- 10.20.193.12:0/1098792999 wait complete. 2026-02-13T21:18:47.742 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-13T21:18:36.309326+0000', 'modified': '2026-02-13T21:18:46.369507+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 56, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24435}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24435': {'gid': 24435, 'name': 'bar.trial090.sdpumd', 'rank': 0, 'incarnation': 14, 'state': 'up:replay', 'state_seq': 1, 'addr': '10.20.193.90:6835/1007071272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6834', 'nonce': 1007071272}, {'type': 'v1', 'addr': '10.20.193.90:6835', 'nonce': 1007071272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 0, 'qdb_cluster': []} 2026-02-13T21:18:47.742 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_24435:up:replay 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: Removing orphan daemon mds.foo.trial012.ebqplc... 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: Removing daemon mds.foo.trial012.ebqplc from trial012 -- ports [] 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/713498148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "bar", "var": "refuse_client_session", "val": "false"}]': finished 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: osdmap e56: 8 total, 8 up, 8 in 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.12:6834/3171735297,v1:10.20.193.12:6835/3171735297] up:reconnect 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: Standby daemon mds.bar.trial090.sdpumd assigned to filesystem bar as rank 0 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: fsmap bar:0/1 3 up:standby, 1 failed 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: fsmap bar:1/1 {0=bar.trial090.sdpumd=up:replay} 2 up:standby 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: Removing key for mds.foo.trial012.ebqplc 2026-02-13T21:18:47.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth rm", "entity": "mds.foo.trial012.ebqplc"} : dispatch 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth rm", "entity": "mds.foo.trial012.ebqplc"}]': finished 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: Removing orphan daemon mds.foo.trial090.ppgikq... 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: Removing daemon mds.foo.trial090.ppgikq from trial090 -- ports [] 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2587868411' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth rm", "entity": "mds.foo.trial090.ppgikq"} : dispatch 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "auth rm", "entity": "mds.foo.trial090.ppgikq"}]': finished 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: osdmap e57: 8 total, 8 up, 8 in 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config rm", "who": "mds.foo", "name": "mds_join_fs"} : dispatch 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix": "config rm", "who": "mds.foo", "name": "mds_join_fs"}]': finished 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix":"config-key del","key":"mgr/cephadm/spec.mds.foo"} : dispatch 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/spec.mds.foo"}]': finished 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T21:18:47.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:47 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2127928634' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:48.743 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T21:18:48.766 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: Removing key for mds.foo.trial090.ppgikq 2026-02-13T21:18:48.766 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: Purge service mds.foo 2026-02-13T21:18:48.766 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] up:reconnect 2026-02-13T21:18:48.766 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: fsmap bar:1/1 {0=bar.trial090.sdpumd=up:reconnect} 1 up:standby 2026-02-13T21:18:48.766 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: pgmap v98: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 5 op/s 2026-02-13T21:18:48.766 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/1098792999' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:48.766 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.767 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.767 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.767 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.767 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:48.767 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:48.767 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.767 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:48 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: Removing key for mds.foo.trial090.ppgikq 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: Purge service mds.foo 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] up:reconnect 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: fsmap bar:1/1 {0=bar.trial090.sdpumd=up:reconnect} 1 up:standby 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: pgmap v98: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 5 op/s 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/1098792999' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T21:18:48.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T21:18:48.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:48.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:48 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T21:18:48.864 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:48.981 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.976+0000 7fc5487fc640 1 -- 10.20.193.12:0/2878666212 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc540109df0 msgr2=0x7fc540152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:48.981 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.976+0000 7fc5487fc640 1 --2- 10.20.193.12:0/2878666212 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc540109df0 0x7fc540152c90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc534009930 tx=0x7fc53402f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:48.981 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.976+0000 7fc5487fc640 1 -- 10.20.193.12:0/2878666212 shutdown_connections 2026-02-13T21:18:48.981 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.976+0000 7fc5487fc640 1 --2- 10.20.193.12:0/2878666212 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc540109df0 0x7fc540152c90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:48.981 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.976+0000 7fc5487fc640 1 --2- 10.20.193.12:0/2878666212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc5401094a0 0x7fc5401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.976+0000 7fc5487fc640 1 -- 10.20.193.12:0/2878666212 >> 10.20.193.12:0/2878666212 conn(0x7fc5400e7050 msgr2=0x7fc5401074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.976+0000 7fc5487fc640 1 -- 10.20.193.12:0/2878666212 shutdown_connections 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.976+0000 7fc5487fc640 1 -- 10.20.193.12:0/2878666212 wait complete. 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5487fc640 1 Processor -- start 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5487fc640 1 -- start start 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5487fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc5401094a0 0x7fc5400f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5487fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc540109df0 0x7fc5400f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5487fc640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc540155d60 con 0x7fc5401094a0 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5487fc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc540155be0 con 0x7fc540109df0 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc546571640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc5401094a0 0x7fc5400f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:48.982 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc546571640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc5401094a0 0x7fc5400f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:51178/0 (socket says 10.20.193.12:51178) 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc546571640 1 -- 10.20.193.12:0/2152617064 learned_addr learned my addr 10.20.193.12:0/2152617064 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc545d70640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc540109df0 0x7fc5400f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc546571640 1 -- 10.20.193.12:0/2152617064 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc540109df0 msgr2=0x7fc5400f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc546571640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc540109df0 0x7fc5400f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc546571640 1 -- 10.20.193.12:0/2152617064 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5400f9110 con 0x7fc5401094a0 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc546571640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc5401094a0 0x7fc5400f38d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc53000d8d0 tx=0x7fc53000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5277fe640 1 -- 10.20.193.12:0/2152617064 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc530014070 con 0x7fc5401094a0 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5400f9400 con 0x7fc5401094a0 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5277fe640 1 -- 10.20.193.12:0/2152617064 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7fc5300044a0 con 0x7fc5401094a0 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5277fe640 1 -- 10.20.193.12:0/2152617064 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc530005020 con 0x7fc5401094a0 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.977+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5400f9990 con 0x7fc5401094a0 2026-02-13T21:18:48.983 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.978+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc540054ad0 con 0x7fc5401094a0 2026-02-13T21:18:48.984 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.979+0000 7fc5277fe640 1 -- 10.20.193.12:0/2152617064 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7fc5300047a0 con 0x7fc5401094a0 2026-02-13T21:18:48.985 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.979+0000 7fc5277fe640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc51c0793f0 0x7fc51c099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:48.985 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.980+0000 7fc5277fe640 1 -- 10.20.193.12:0/2152617064 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6492+0+0 (secure 0 0 0) 0x7fc53009cc30 con 0x7fc5401094a0 2026-02-13T21:18:48.985 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.980+0000 7fc545d70640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc51c0793f0 0x7fc51c099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:48.985 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.980+0000 7fc545d70640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc51c0793f0 0x7fc51c099900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5400e7eb0 tx=0x7fc53403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:48.985 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:48.982+0000 7fc5277fe640 1 -- 10.20.193.12:0/2152617064 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7fc530069970 con 0x7fc5401094a0 2026-02-13T21:18:49.115 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.112+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5400f9d00 con 0x7fc5401094a0 2026-02-13T21:18:49.115 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.112+0000 7fc5277fe640 1 -- 10.20.193.12:0/2152617064 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3599 (secure 0 0 0) 0x7fc53006ea70 con 0x7fc5401094a0 2026-02-13T21:18:49.116 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:49.116 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":16,"btime":"2026-02-13T21:18:48:371265+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"bar.trial012.ffjxty","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"10.20.193.12:6837/878511953","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6836","nonce":878511953},{"type":"v1","addr":"10.20.193.12:6837","nonce":878511953}]},"join_fscid":1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T21:18:36.309326+0000","modified":"2026-02-13T21:18:47.373871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24435":{"gid":24435,"name":"bar.trial090.sdpumd","rank":0,"incarnation":14,"state":"up:rejoin","state_seq":3,"addr":"10.20.193.90:6835/1007071272","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1007071272},{"type":"v1","addr":"10.20.193.90:6835","nonce":1007071272}]},"join_fscid":1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2026-02-13T21:18:49.117 INFO:teuthology.orchestra.run.trial012.stderr:dumped fsmap epoch 16 2026-02-13T21:18:49.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc51c0793f0 msgr2=0x7fc51c099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:49.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc51c0793f0 0x7fc51c099900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5400e7eb0 tx=0x7fc53403a040 comp rx=0 tx=0).stop 2026-02-13T21:18:49.117 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc5401094a0 msgr2=0x7fc5400f38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:49.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc5401094a0 0x7fc5400f38d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc53000d8d0 tx=0x7fc53000dda0 comp rx=0 tx=0).stop 2026-02-13T21:18:49.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 shutdown_connections 2026-02-13T21:18:49.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7fc51c0793f0 0x7fc51c099900 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:49.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc540109df0 0x7fc5400f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:49.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 --2- 10.20.193.12:0/2152617064 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7fc5401094a0 0x7fc5400f38d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:49.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 >> 10.20.193.12:0/2152617064 conn(0x7fc5400e7050 msgr2=0x7fc5400edea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:49.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 shutdown_connections 2026-02-13T21:18:49.118 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:49.113+0000 7fc5487fc640 1 -- 10.20.193.12:0/2152617064 wait complete. 2026-02-13T21:18:49.153 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-13T21:18:36.309326+0000', 'modified': '2026-02-13T21:18:47.373871+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 56, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24435}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24435': {'gid': 24435, 'name': 'bar.trial090.sdpumd', 'rank': 0, 'incarnation': 14, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '10.20.193.90:6835/1007071272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6834', 'nonce': 1007071272}, {'type': 'v1', 'addr': '10.20.193.90:6835', 'nonce': 1007071272}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 0, 'qdb_cluster': []} 2026-02-13T21:18:49.154 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_24435:up:rejoin 2026-02-13T21:18:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:49 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] up:rejoin 2026-02-13T21:18:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:49 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.12:6836/878511953,v1:10.20.193.12:6837/878511953] up:standby 2026-02-13T21:18:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:49 trial090 ceph-mon[42877]: fsmap bar:1/1 {0=bar.trial090.sdpumd=up:rejoin} 1 up:standby 2026-02-13T21:18:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:49 trial090 ceph-mon[42877]: daemon mds.bar.trial090.sdpumd is now active in filesystem bar as rank 0 2026-02-13T21:18:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:49 trial090 ceph-mon[42877]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:49.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:49 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2152617064' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:49.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:49 trial090 ceph-mon[42877]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-13T21:18:49.773 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:49 trial090 ceph-mon[42877]: Cluster is now healthy 2026-02-13T21:18:49.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:49 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] up:rejoin 2026-02-13T21:18:49.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:49 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.12:6836/878511953,v1:10.20.193.12:6837/878511953] up:standby 2026-02-13T21:18:49.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:49 trial012 ceph-mon[37926]: fsmap bar:1/1 {0=bar.trial090.sdpumd=up:rejoin} 1 up:standby 2026-02-13T21:18:49.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:49 trial012 ceph-mon[37926]: daemon mds.bar.trial090.sdpumd is now active in filesystem bar as rank 0 2026-02-13T21:18:49.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:49 trial012 ceph-mon[37926]: from='mgr.14215 10.20.193.12:0/696933000' entity='mgr.trial012.zqhrrq' 2026-02-13T21:18:49.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:49 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2152617064' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:49.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:49 trial012 ceph-mon[37926]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-13T21:18:49.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:49 trial012 ceph-mon[37926]: Cluster is now healthy 2026-02-13T21:18:50.155 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T21:18:50.274 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:50.392 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.387+0000 7f0432845640 1 -- 10.20.193.12:0/2989836430 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 msgr2=0x7f042c10bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.392 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.387+0000 7f0432845640 1 --2- 10.20.193.12:0/2989836430 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 0x7f042c10bcb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0418005fd0 tx=0x7f041802f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.392 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.387+0000 7f0432845640 1 -- 10.20.193.12:0/2989836430 shutdown_connections 2026-02-13T21:18:50.392 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.387+0000 7f0432845640 1 --2- 10.20.193.12:0/2989836430 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f042c10c1f0 0x7f042c150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.387+0000 7f0432845640 1 --2- 10.20.193.12:0/2989836430 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 0x7f042c10bcb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.387+0000 7f0432845640 1 -- 10.20.193.12:0/2989836430 >> 10.20.193.12:0/2989836430 conn(0x7f042c060f70 msgr2=0x7f042c0613d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.387+0000 7f0432845640 1 -- 10.20.193.12:0/2989836430 shutdown_connections 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.387+0000 7f0432845640 1 -- 10.20.193.12:0/2989836430 wait complete. 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f0432845640 1 Processor -- start 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f0432845640 1 -- start start 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f0432845640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 0x7f042c0f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f0432845640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f042c10c1f0 0x7f042c0f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f0432845640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f042c153b30 con 0x7f042c10b8a0 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f0432845640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f042c1539b0 con 0x7f042c10c1f0 2026-02-13T21:18:50.393 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042bfff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 0x7f042c0f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042bfff640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 0x7f042c0f4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:48730/0 (socket says 10.20.193.12:48730) 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042bfff640 1 -- 10.20.193.12:0/2997869566 learned_addr learned my addr 10.20.193.12:0/2997869566 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042bfff640 1 -- 10.20.193.12:0/2997869566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f042c10c1f0 msgr2=0x7f042c0f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042b7fe640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f042c10c1f0 0x7f042c0f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042bfff640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f042c10c1f0 0x7f042c0f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042bfff640 1 -- 10.20.193.12:0/2997869566 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042c0fa5c0 con 0x7f042c10b8a0 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042b7fe640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f042c10c1f0 0x7f042c0f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f042bfff640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 0x7f042c0f4d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0418005a20 tx=0x7f0418002d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f04297fa640 1 -- 10.20.193.12:0/2997869566 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0418046070 con 0x7f042c10b8a0 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042c0fa850 con 0x7f042c10b8a0 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f04297fa640 1 -- 10.20.193.12:0/2997869566 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f04180044b0 con 0x7f042c10b8a0 2026-02-13T21:18:50.394 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f04297fa640 1 -- 10.20.193.12:0/2997869566 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f04180416c0 con 0x7f042c10b8a0 2026-02-13T21:18:50.395 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.388+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f042c0fae00 con 0x7f042c10b8a0 2026-02-13T21:18:50.395 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.389+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f042c052680 con 0x7f042c10b8a0 2026-02-13T21:18:50.395 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.390+0000 7f04297fa640 1 -- 10.20.193.12:0/2997869566 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f0418038a00 con 0x7f042c10b8a0 2026-02-13T21:18:50.396 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.390+0000 7f04297fa640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04000793f0 0x7f0400099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.396 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.390+0000 7f042b7fe640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04000793f0 0x7f0400099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.396 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.390+0000 7f04297fa640 1 -- 10.20.193.12:0/2997869566 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6492+0+0 (secure 0 0 0) 0x7f041803e070 con 0x7f042c10b8a0 2026-02-13T21:18:50.396 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.391+0000 7f042b7fe640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04000793f0 0x7f0400099900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f042c0ea590 tx=0x7f041c005f50 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:50.396 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.393+0000 7f04297fa640 1 -- 10.20.193.12:0/2997869566 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f0418050080 con 0x7f042c10b8a0 2026-02-13T21:18:50.529 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.526+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f042c10bcb0 con 0x7f042c10b8a0 2026-02-13T21:18:50.529 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:50 trial012 ceph-mon[37926]: mds.? [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] up:active 2026-02-13T21:18:50.529 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:50 trial012 ceph-mon[37926]: fsmap bar:1 {0=bar.trial090.sdpumd=up:active} 1 up:standby 2026-02-13T21:18:50.530 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:50 trial012 ceph-mon[37926]: pgmap v99: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 1.7 KiB/s rd, 1 op/s 2026-02-13T21:18:50.530 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.526+0000 7f04297fa640 1 -- 10.20.193.12:0/2997869566 <== mon.0 v2:10.20.193.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3608 (secure 0 0 0) 0x7f041808e590 con 0x7f042c10b8a0 2026-02-13T21:18:50.530 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:50.531 INFO:teuthology.orchestra.run.trial012.stdout:{"epoch":17,"btime":"2026-02-13T21:18:49:372104+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"bar.trial012.ffjxty","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"10.20.193.12:6837/878511953","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.12:6836","nonce":878511953},{"type":"v1","addr":"10.20.193.12:6837","nonce":878511953}]},"join_fscid":1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-13T21:18:36.309326+0000","modified":"2026-02-13T21:18:49.372090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24435},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24435":{"gid":24435,"name":"bar.trial090.sdpumd","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6835/1007071272","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1007071272},{"type":"v1","addr":"10.20.193.90:6835","nonce":1007071272}]},"join_fscid":1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24435,"qdb_cluster":[24435]},"id":1}]} 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:dumped fsmap epoch 17 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04000793f0 msgr2=0x7f0400099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04000793f0 0x7f0400099900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f042c0ea590 tx=0x7f041c005f50 comp rx=0 tx=0).stop 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 msgr2=0x7f042c0f4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 0x7f042c0f4d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0418005a20 tx=0x7f0418002d90 comp rx=0 tx=0).stop 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 shutdown_connections 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f04000793f0 0x7f0400099900 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f042c10c1f0 0x7f042c0f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 --2- 10.20.193.12:0/2997869566 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f042c10b8a0 0x7f042c0f4d80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.532 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 >> 10.20.193.12:0/2997869566 conn(0x7f042c060f70 msgr2=0x7f042c0ef350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:50.533 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 shutdown_connections 2026-02-13T21:18:50.533 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.527+0000 7f0432845640 1 -- 10.20.193.12:0/2997869566 wait complete. 2026-02-13T21:18:50.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-13T21:18:36.309326+0000', 'modified': '2026-02-13T21:18:49.372090+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 56, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24435}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24435': {'gid': 24435, 'name': 'bar.trial090.sdpumd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.90:6835/1007071272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6834', 'nonce': 1007071272}, {'type': 'v1', 'addr': '10.20.193.90:6835', 'nonce': 1007071272}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24435, 'qdb_cluster': [24435]} 2026-02-13T21:18:50.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-13T21:18:50.571 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph tell mds.bar.trial090.sdpumd status 2026-02-13T21:18:50.689 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:50.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:50 trial090 ceph-mon[42877]: mds.? [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] up:active 2026-02-13T21:18:50.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:50 trial090 ceph-mon[42877]: fsmap bar:1 {0=bar.trial090.sdpumd=up:active} 1 up:standby 2026-02-13T21:18:50.772 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:50 trial090 ceph-mon[42877]: pgmap v99: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 1.7 KiB/s rd, 1 op/s 2026-02-13T21:18:50.800 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.797+0000 7faf393e3640 1 -- 10.20.193.12:0/2366319373 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 msgr2=0x7faf34112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.800 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.797+0000 7faf393e3640 1 --2- 10.20.193.12:0/2366319373 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 0x7faf34112a20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005fd0 tx=0x7faf1c02f1d0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.800 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.797+0000 7faf393e3640 1 -- 10.20.193.12:0/2366319373 shutdown_connections 2026-02-13T21:18:50.800 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.797+0000 7faf393e3640 1 --2- 10.20.193.12:0/2366319373 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 0x7faf34112a20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.800 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.797+0000 7faf393e3640 1 --2- 10.20.193.12:0/2366319373 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf3410ccd0 0x7faf3410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.800 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.797+0000 7faf393e3640 1 -- 10.20.193.12:0/2366319373 >> 10.20.193.12:0/2366319373 conn(0x7faf340ea470 msgr2=0x7faf3410a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:50.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.797+0000 7faf393e3640 1 -- 10.20.193.12:0/2366319373 shutdown_connections 2026-02-13T21:18:50.801 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.797+0000 7faf393e3640 1 -- 10.20.193.12:0/2366319373 wait complete. 2026-02-13T21:18:50.802 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf393e3640 1 Processor -- start 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf393e3640 1 -- start start 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf393e3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf3410ccd0 0x7faf3411b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf393e3640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 0x7faf3411bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf393e3640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf34155db0 con 0x7faf34112610 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf393e3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faf34155c30 con 0x7faf3410ccd0 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf327fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 0x7faf3411bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf327fc640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 0x7faf3411bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:48748/0 (socket says 10.20.193.12:48748) 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf327fc640 1 -- 10.20.193.12:0/2851142760 learned_addr learned my addr 10.20.193.12:0/2851142760 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf32ffd640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf3410ccd0 0x7faf3411b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf327fc640 1 -- 10.20.193.12:0/2851142760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf3410ccd0 msgr2=0x7faf3411b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf327fc640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf3410ccd0 0x7faf3411b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.803 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf327fc640 1 -- 10.20.193.12:0/2851142760 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf34120f80 con 0x7faf34112610 2026-02-13T21:18:50.804 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.799+0000 7faf327fc640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 0x7faf3411bcc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faf1c002c70 tx=0x7faf1c002ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:50.804 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.800+0000 7faf13fff640 1 -- 10.20.193.12:0/2851142760 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf1c046070 con 0x7faf34112610 2026-02-13T21:18:50.804 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.800+0000 7faf13fff640 1 -- 10.20.193.12:0/2851142760 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7faf1c004420 con 0x7faf34112610 2026-02-13T21:18:50.804 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.800+0000 7faf393e3640 1 -- 10.20.193.12:0/2851142760 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf34121210 con 0x7faf34112610 2026-02-13T21:18:50.804 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.800+0000 7faf13fff640 1 -- 10.20.193.12:0/2851142760 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf1c041630 con 0x7faf34112610 2026-02-13T21:18:50.804 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.800+0000 7faf393e3640 1 -- 10.20.193.12:0/2851142760 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf341217c0 con 0x7faf34112610 2026-02-13T21:18:50.811 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.801+0000 7faf13fff640 1 -- 10.20.193.12:0/2851142760 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7faf1c04b440 con 0x7faf34112610 2026-02-13T21:18:50.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.801+0000 7faf13fff640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7faf080793f0 0x7faf08099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf13fff640 1 -- 10.20.193.12:0/2851142760 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6492+0+0 (secure 0 0 0) 0x7faf1c03e070 con 0x7faf34112610 2026-02-13T21:18:50.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7faf080793f0 0x7faf08099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf3f936e00 1 Processor -- start 2026-02-13T21:18:50.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf3f936e00 1 -- start start 2026-02-13T21:18:50.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7faf080793f0 0x7faf08099900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf34122010 tx=0x7faf28009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:50.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf3f936e00 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096804b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.812 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf3f936e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x5580968050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf3f936e00 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x55809671c9a0 con 0x55809639f720 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf3f936e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5580966bd880 con 0x5580963d15b0 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096804b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096804b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:48754/0 (socket says 10.20.193.12:48754) 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 -- 10.20.193.12:0/2748254211 learned_addr learned my addr 10.20.193.12:0/2748254211 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf327fc640 1 --2- 10.20.193.12:0/2748254211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x5580968050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 -- 10.20.193.12:0/2748254211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 msgr2=0x5580968050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 --2- 10.20.193.12:0/2748254211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x5580968050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 -- 10.20.193.12:0/2748254211 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558096774c90 con 0x55809639f720 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf327fc640 1 --2- 10.20.193.12:0/2748254211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x5580968050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T21:18:50.813 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.802+0000 7faf32ffd640 1 --2- 10.20.193.12:0/2748254211 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096804b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faf28004520 tx=0x7faf28013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a16a2983fd3b8b server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faeff7fe640 1 -- 10.20.193.12:0/2748254211 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf28009d10 con 0x55809639f720 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faeff7fe640 1 -- 10.20.193.12:0/2748254211 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7faf28015070 con 0x55809639f720 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faeff7fe640 1 -- 10.20.193.12:0/2748254211 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf2801a5f0 con 0x55809639f720 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faf3f936e00 1 -- 10.20.193.12:0/2748254211 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 msgr2=0x558096804b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faf3f936e00 1 --2- 10.20.193.12:0/2748254211 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096804b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faf28004520 tx=0x7faf28013000 comp rx=0 tx=0).stop 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faf3f936e00 1 -- 10.20.193.12:0/2748254211 shutdown_connections 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faf3f936e00 1 --2- 10.20.193.12:0/2748254211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x5580968050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faf3f936e00 1 --2- 10.20.193.12:0/2748254211 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096804b90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faf3f936e00 1 -- 10.20.193.12:0/2748254211 >> 10.20.193.12:0/2748254211 conn(0x5580963da0e0 msgr2=0x558096803470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:50.814 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faf3f936e00 1 -- 10.20.193.12:0/2748254211 shutdown_connections 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.803+0000 7faf3f936e00 1 -- 10.20.193.12:0/2748254211 wait complete. 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.804+0000 7faf3f936e00 1 -- start start 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.804+0000 7faf3f936e00 1 Processor -- start 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.804+0000 7faf3f936e00 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.804+0000 7faf3f936e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.804+0000 7faf3f936e00 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x5580964f8d60 con 0x55809639f720 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.804+0000 7faf3f936e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55809681ea90 con 0x5580963d15b0 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 10 client.0 _ll_register_callbacks cb 0x5580966ba0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf32ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf32ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:48770/0 (socket says 10.20.193.12:48770) 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf32ffd640 1 -- 10.20.193.12:0/4290752485 learned_addr learned my addr 10.20.193.12:0/4290752485 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:50.815 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf327fc640 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf32ffd640 1 -- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 msgr2=0x55809681e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf32ffd640 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf32ffd640 1 -- 10.20.193.12:0/4290752485 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558096816e50 con 0x55809639f720 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf327fc640 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf32ffd640 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681df10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faf28009b10 tx=0x7faf2801dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3100147eb4835da0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faefcff9640 10 client.0 ms_handle_connect on v2:10.20.193.12:3300/0 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faefcff9640 1 -- 10.20.193.12:0/4290752485 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf2801aa70 con 0x55809639f720 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faefcff9640 1 -- 10.20.193.12:0/4290752485 <== mon.0 v2:10.20.193.12:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6492+0+0 (secure 0 0 0) 0x7faf2802d070 con 0x55809639f720 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 1 -- 10.20.193.12:0/4290752485 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55809672bc40 con 0x55809639f720 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faefcff9640 1 -- 10.20.193.12:0/4290752485 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7faf2803a050 con 0x55809639f720 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 10 client.14758 fetch_fsmap learned FSMap version 17 2026-02-13T21:18:50.816 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 1 -- 10.20.193.12:0/4290752485 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=3+}) -- 0x5580963e9680 con 0x55809639f720 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faefcff9640 1 -- 10.20.193.12:0/4290752485 <== mon.0 v2:10.20.193.12:3300/0 4 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x55809672bc40 con 0x55809639f720 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faefcff9640 1 -- 10.20.193.12:0/4290752485 <== mon.0 v2:10.20.193.12:3300/0 5 ==== fsmap(e 17) ==== 2325+0+0 (secure 0 0 0) 0x7faf2803d020 con 0x55809639f720 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 10 client.14758 fetch_fsmap finished waiting for FSMap version 17 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 10 client.14758 resolve_mds: resolved name 'bar.trial090.sdpumd' to daemon mds.bar.trial090.sdpumd 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 20 client.14758 populate_metadata read hostname 'trial012' 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] conn(0x5580963d9790 0x558096848050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 4 client.14758 mds_command: new command op to 24435 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf3f936e00 1 -- 10.20.193.12:0/4290752485 --> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558096727440 con 0x5580963d9790 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.805+0000 7faf327fc640 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] conn(0x5580963d9790 0x558096848050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.806+0000 7faf327fc640 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] conn(0x5580963d9790 0x558096848050 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=638006384632227e server_cookie=a6df0101d9fcc74a in_seq=0 out_seq=0 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.806+0000 7faefcff9640 10 client.14758 ms_handle_connect on v2:10.20.193.90:6834/1007071272 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.806+0000 7faefcff9640 1 -- 10.20.193.12:0/4290752485 <== mds.0 v2:10.20.193.90:6834/1007071272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558096727440 con 0x5580963d9790 2026-02-13T21:18:50.817 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.806+0000 7faefcff9640 10 client.14758 handle_command_reply: tid=0 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.806+0000 7faf3f936e00 1 client.14758 shutdown 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 -- 10.20.193.12:0/4290752485 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 msgr2=0x55809681df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681df10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faf28009b10 tx=0x7faf2801dce0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 -- 10.20.193.12:0/4290752485 shutdown_connections 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] conn(0x5580963d9790 0x558096848050 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 --2- 10.20.193.12:0/4290752485 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681df10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faefcff9640 0 client.14758 ms_handle_reset on v2:10.20.193.90:6834/1007071272 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 -- 10.20.193.12:0/4290752485 >> 10.20.193.12:0/4290752485 conn(0x5580963da0e0 msgr2=0x558096803c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 -- 10.20.193.12:0/4290752485 shutdown_connections 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 1 -- 10.20.193.12:0/4290752485 wait complete. 2026-02-13T21:18:50.818 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.807+0000 7faf3f936e00 20 client.14758 trim_cache size 0 max 16384 2026-02-13T21:18:50.824 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.815+0000 7faf3f936e00 1 Processor -- start 2026-02-13T21:18:50.824 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.815+0000 7faf3f936e00 1 -- start start 2026-02-13T21:18:50.824 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf3f936e00 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.824 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf3f936e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.824 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf3f936e00 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7faed800b6a0 con 0x55809639f720 2026-02-13T21:18:50.824 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf3f936e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faed800a720 con 0x5580963d15b0 2026-02-13T21:18:50.824 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf32ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.824 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf32ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:48778/0 (socket says 10.20.193.12:48778) 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf32ffd640 1 -- 10.20.193.12:0/3860916452 learned_addr learned my addr 10.20.193.12:0/3860916452 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf327fc640 1 --2- 10.20.193.12:0/3860916452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf32ffd640 1 -- 10.20.193.12:0/3860916452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 msgr2=0x55809681af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf32ffd640 1 --2- 10.20.193.12:0/3860916452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf32ffd640 1 -- 10.20.193.12:0/3860916452 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580964db950 con 0x55809639f720 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faf32ffd640 1 --2- 10.20.193.12:0/3860916452 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681d250 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faf28009b40 tx=0x7faf28004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513c3ad6cd866113 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faefeffd640 1 -- 10.20.193.12:0/3860916452 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf28042070 con 0x55809639f720 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faefeffd640 1 -- 10.20.193.12:0/3860916452 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7faf28015070 con 0x55809639f720 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.816+0000 7faefeffd640 1 -- 10.20.193.12:0/3860916452 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf2801d710 con 0x55809639f720 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 -- 10.20.193.12:0/3860916452 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 msgr2=0x55809681d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 --2- 10.20.193.12:0/3860916452 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681d250 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faf28009b40 tx=0x7faf28004d00 comp rx=0 tx=0).stop 2026-02-13T21:18:50.825 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 -- 10.20.193.12:0/3860916452 shutdown_connections 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 --2- 10.20.193.12:0/3860916452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x55809681af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 --2- 10.20.193.12:0/3860916452 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x55809681d250 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 -- 10.20.193.12:0/3860916452 >> 10.20.193.12:0/3860916452 conn(0x5580963da0e0 msgr2=0x55809681fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 -- 10.20.193.12:0/3860916452 shutdown_connections 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 -- 10.20.193.12:0/3860916452 wait complete. 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 -- start start 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 Processor -- start 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096829ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x558096825920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x558096718230 con 0x55809639f720 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558096846840 con 0x5580963d15b0 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf3f936e00 10 client.0 _ll_register_callbacks cb 0x5580966cc3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-13T21:18:50.826 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.817+0000 7faf32ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096829ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf32ffd640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096829ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:48792/0 (socket says 10.20.193.12:48792) 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf32ffd640 1 -- 10.20.193.12:0/2189843816 learned_addr learned my addr 10.20.193.12:0/2189843816 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf327fc640 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x558096825920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf32ffd640 1 -- 10.20.193.12:0/2189843816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 msgr2=0x558096825920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf32ffd640 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x558096825920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf32ffd640 1 -- 10.20.193.12:0/2189843816 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558096816c80 con 0x55809639f720 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf32ffd640 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096829ef0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faf2803e050 tx=0x7faf28004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00a4a0ea6e19574 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faefcff9640 10 client.0 ms_handle_connect on v2:10.20.193.12:3300/0 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faefcff9640 1 -- 10.20.193.12:0/2189843816 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf2804a070 con 0x55809639f720 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faefcff9640 1 -- 10.20.193.12:0/2189843816 <== mon.0 v2:10.20.193.12:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6492+0+0 (secure 0 0 0) 0x7faf2802d070 con 0x55809639f720 2026-02-13T21:18:50.827 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 1 -- 10.20.193.12:0/2189843816 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf28015070 con 0x55809639f720 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faefcff9640 1 -- 10.20.193.12:0/2189843816 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7faf28057050 con 0x55809639f720 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 10 client.14762 fetch_fsmap learned FSMap version 17 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 1 -- 10.20.193.12:0/2189843816 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=3+}) -- 0x558096816840 con 0x55809639f720 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faefcff9640 1 -- 10.20.193.12:0/2189843816 <== mon.0 v2:10.20.193.12:3300/0 4 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7faf28015070 con 0x55809639f720 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faefcff9640 1 -- 10.20.193.12:0/2189843816 <== mon.0 v2:10.20.193.12:3300/0 5 ==== fsmap(e 17) ==== 2325+0+0 (secure 0 0 0) 0x7faf2805a020 con 0x55809639f720 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 10 client.14762 fetch_fsmap finished waiting for FSMap version 17 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 10 client.14762 resolve_mds: resolved name 'bar.trial090.sdpumd' to daemon mds.bar.trial090.sdpumd 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 20 client.14762 populate_metadata read hostname 'trial012' 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] conn(0x5580963b9040 0x558096871400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 4 client.14762 mds_command: new command op to 24435 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.818+0000 7faf3f936e00 1 -- 10.20.193.12:0/2189843816 --> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] -- command(tid 0: {"prefix": "status"}) -- 0x558096724870 con 0x5580963b9040 2026-02-13T21:18:50.828 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf327fc640 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] conn(0x5580963b9040 0x558096871400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf327fc640 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] conn(0x5580963b9040 0x558096871400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9954ebe0c76c879 server_cookie=d0bcc491ef2aeece in_seq=0 out_seq=0 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faefcff9640 10 client.14762 ms_handle_connect on v2:10.20.193.90:6834/1007071272 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faefcff9640 1 -- 10.20.193.12:0/2189843816 <== mds.0 v2:10.20.193.90:6834/1007071272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1212 (crc 0 0 0) 0x558096724870 con 0x5580963b9040 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faefcff9640 10 client.14762 handle_command_reply: tid=0 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 client.14762 shutdown 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 -- 10.20.193.12:0/2189843816 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 msgr2=0x558096829ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096829ef0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faf2803e050 tx=0x7faf28004b30 comp rx=0 tx=0).stop 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 -- 10.20.193.12:0/2189843816 shutdown_connections 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.90:6834/1007071272,v1:10.20.193.90:6835/1007071272] conn(0x5580963b9040 0x558096871400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5580963d15b0 0x558096825920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 --2- 10.20.193.12:0/2189843816 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x55809639f720 0x558096829ef0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faefcff9640 0 client.14762 ms_handle_reset on v2:10.20.193.90:6834/1007071272 2026-02-13T21:18:50.829 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 -- 10.20.193.12:0/2189843816 >> 10.20.193.12:0/2189843816 conn(0x5580963da0e0 msgr2=0x5580968229d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:50.830 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 -- 10.20.193.12:0/2189843816 shutdown_connections 2026-02-13T21:18:50.830 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 1 -- 10.20.193.12:0/2189843816 wait complete. 2026-02-13T21:18:50.830 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.819+0000 7faf3f936e00 20 client.14762 trim_cache size 0 max 16384 2026-02-13T21:18:50.830 INFO:teuthology.orchestra.run.trial012.stdout:{ 2026-02-13T21:18:50.830 INFO:teuthology.orchestra.run.trial012.stdout: "cluster_fsid": "3551db35-0921-11f1-800a-d404e6e7d460", 2026-02-13T21:18:50.830 INFO:teuthology.orchestra.run.trial012.stdout: "whoami": 0, 2026-02-13T21:18:50.830 INFO:teuthology.orchestra.run.trial012.stdout: "id": 24435, 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "want_state": "up:active", 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "state": "up:active", 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "fs_name": "bar", 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "rank_uptime": 4.4493480490000001, 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "mdsmap_epoch": 17, 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "osdmap_epoch": 57, 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "osdmap_epoch_barrier": 57, 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "uptime": 5.8452441479999999, 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "sysinfo": { 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "arch": "x86_64", 2026-02-13T21:18:50.831 INFO:teuthology.orchestra.run.trial012.stdout: "ceph_release": "tentacle", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "ceph_version": "ceph version 20.2.0-690-g3baf6bae (3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) tentacle (stable - Debug)", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "ceph_version_short": "20.2.0-690-g3baf6bae", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "container_hostname": "trial090", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "distro": "centos", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "distro_description": "CentOS Stream 9", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "distro_version": "9", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "hostname": "trial090", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-13T21:18:50.832 INFO:teuthology.orchestra.run.trial012.stdout: "mem_swap_kb": "8388604", 2026-02-13T21:18:50.833 INFO:teuthology.orchestra.run.trial012.stdout: "mem_total_kb": "130438948", 2026-02-13T21:18:50.833 INFO:teuthology.orchestra.run.trial012.stdout: "os": "Linux" 2026-02-13T21:18:50.833 INFO:teuthology.orchestra.run.trial012.stdout: }, 2026-02-13T21:18:50.833 INFO:teuthology.orchestra.run.trial012.stdout: "endian": "little" 2026-02-13T21:18:50.833 INFO:teuthology.orchestra.run.trial012.stdout:} 2026-02-13T21:18:50.834 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 -- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7faf080793f0 msgr2=0x7faf08099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.834 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7faf080793f0 0x7faf08099900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf34122010 tx=0x7faf28009260 comp rx=0 tx=0).stop 2026-02-13T21:18:50.834 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 -- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 msgr2=0x7faf3411bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:50.834 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 0x7faf3411bcc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faf1c002c70 tx=0x7faf1c002ca0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.834 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 -- 10.20.193.12:0/2851142760 shutdown_connections 2026-02-13T21:18:50.834 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7faf080793f0 0x7faf08099900 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.834 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7faf34112610 0x7faf3411bcc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 --2- 10.20.193.12:0/2851142760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf3410ccd0 0x7faf3411b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:50.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 -- 10.20.193.12:0/2851142760 >> 10.20.193.12:0/2851142760 conn(0x7faf340ea470 msgr2=0x7faf3410a890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:50.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 -- 10.20.193.12:0/2851142760 shutdown_connections 2026-02-13T21:18:50.835 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:50.820+0000 7faf393e3640 1 -- 10.20.193.12:0/2851142760 wait complete. 2026-02-13T21:18:50.873 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-13T21:18:50.887 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial012.front.sepia.ceph.com 2026-02-13T21:18:50.887 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- bash -c 'set -ex 2026-02-13T21:18:50.888 DEBUG:teuthology.orchestra.run.trial012:> ceph orch ls mds --format=json | jq ".[] | .service_name" | grep "mds.bar" 2026-02-13T21:18:50.888 DEBUG:teuthology.orchestra.run.trial012:> ' 2026-02-13T21:18:51.005 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:51.066 INFO:teuthology.orchestra.run.trial012.stderr:+ ceph orch ls mds --format=json 2026-02-13T21:18:51.066 INFO:teuthology.orchestra.run.trial012.stderr:+ jq '.[] | .service_name' 2026-02-13T21:18:51.066 INFO:teuthology.orchestra.run.trial012.stderr:+ grep mds.bar 2026-02-13T21:18:51.122 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.117+0000 7f16b4b34640 1 -- 10.20.193.12:0/581013939 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b01094b0 msgr2=0x7f16b0109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.117+0000 7f16b4b34640 1 --2- 10.20.193.12:0/581013939 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b01094b0 0x7f16b0109920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009840 tx=0x7f16a402f160 comp rx=0 tx=0).stop 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 -- 10.20.193.12:0/581013939 shutdown_connections 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 --2- 10.20.193.12:0/581013939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16b010a5e0 0x7f16b010a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 --2- 10.20.193.12:0/581013939 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b01094b0 0x7f16b0109920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 -- 10.20.193.12:0/581013939 >> 10.20.193.12:0/581013939 conn(0x7f16b00e6b50 msgr2=0x7f16b0107000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 -- 10.20.193.12:0/581013939 shutdown_connections 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 -- 10.20.193.12:0/581013939 wait complete. 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 Processor -- start 2026-02-13T21:18:51.123 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 -- start start 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16b01094b0 0x7f16b0054c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b010a5e0 0x7f16b0055270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 -- --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_getmap magic: 0 -- 0x7f16b014e2c0 con 0x7f16b010a5e0 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.118+0000 7f16b4b34640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16b014e140 con 0x7f16b01094b0 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16add74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b010a5e0 0x7f16b0055270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16add74640 1 --2- >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b010a5e0 0x7f16b0055270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.12:3300/0 says I am v2:10.20.193.12:48806/0 (socket says 10.20.193.12:48806) 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16add74640 1 -- 10.20.193.12:0/4293734377 learned_addr learned my addr 10.20.193.12:0/4293734377 (peer_addr_for_me v2:10.20.193.12:0/0) 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16ae575640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16b01094b0 0x7f16b0054c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16add74640 1 -- 10.20.193.12:0/4293734377 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16b01094b0 msgr2=0x7f16b0054c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16add74640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16b01094b0 0x7f16b0054c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:51.124 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16add74640 1 -- 10.20.193.12:0/4293734377 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b00f5270 con 0x7f16b010a5e0 2026-02-13T21:18:51.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16add74640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b010a5e0 0x7f16b0055270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1698005970 tx=0x7f169800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:51.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16977fe640 1 -- 10.20.193.12:0/4293734377 <== mon.0 v2:10.20.193.12:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f169800ca90 con 0x7f16b010a5e0 2026-02-13T21:18:51.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16977fe640 1 -- 10.20.193.12:0/4293734377 <== mon.0 v2:10.20.193.12:3300/0 2 ==== config(26 keys) ==== 1069+0+0 (secure 0 0 0) 0x7f1698004d10 con 0x7f16b010a5e0 2026-02-13T21:18:51.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b00f5560 con 0x7f16b010a5e0 2026-02-13T21:18:51.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16977fe640 1 -- 10.20.193.12:0/4293734377 <== mon.0 v2:10.20.193.12:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f16980056f0 con 0x7f16b010a5e0 2026-02-13T21:18:51.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b00f5af0 con 0x7f16b010a5e0 2026-02-13T21:18:51.125 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.119+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 --> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b014eaa0 con 0x7f16b010a5e0 2026-02-13T21:18:51.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.121+0000 7f16977fe640 1 -- 10.20.193.12:0/4293734377 <== mon.0 v2:10.20.193.12:3300/0 4 ==== mgrmap(e 19) ==== 103475+0+0 (secure 0 0 0) 0x7f1698004ec0 con 0x7f16b010a5e0 2026-02-13T21:18:51.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.121+0000 7f16977fe640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f16880794b0 0x7f16880999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T21:18:51.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.121+0000 7f16ae575640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f16880794b0 0x7f16880999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T21:18:51.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.121+0000 7f16977fe640 1 -- 10.20.193.12:0/4293734377 <== mon.0 v2:10.20.193.12:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6492+0+0 (secure 0 0 0) 0x7f169809ceb0 con 0x7f16b010a5e0 2026-02-13T21:18:51.126 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.121+0000 7f16ae575640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f16880794b0 0x7f16880999c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002fd0 tx=0x7f16a403a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T21:18:51.127 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.124+0000 7f16977fe640 1 -- 10.20.193.12:0/4293734377 <== mon.0 v2:10.20.193.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (secure 0 0 0) 0x7f1698016330 con 0x7f16b010a5e0 2026-02-13T21:18:51.238 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.235+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 --> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] -- mgr_command(tid 0: {"prefix": "orch ls", "service_type": "mds", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16b00ebd00 con 0x7f16880794b0 2026-02-13T21:18:51.240 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.238+0000 7f16977fe640 1 -- 10.20.193.12:0/4293734377 <== mgr.14215 v2:10.20.193.12:6800/1207525031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+317 (secure 0 0 0) 0x7f16b00ebd00 con 0x7f16880794b0 2026-02-13T21:18:51.242 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f16880794b0 msgr2=0x7f16880999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:51.242 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f16880794b0 0x7f16880999c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002fd0 tx=0x7f16a403a040 comp rx=0 tx=0).stop 2026-02-13T21:18:51.242 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b010a5e0 msgr2=0x7f16b0055270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T21:18:51.242 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b010a5e0 0x7f16b0055270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1698005970 tx=0x7f169800ede0 comp rx=0 tx=0).stop 2026-02-13T21:18:51.242 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 shutdown_connections 2026-02-13T21:18:51.242 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:6800/1207525031,v1:10.20.193.12:6801/1207525031] conn(0x7f16880794b0 0x7f16880999c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:51.242 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.12:3300/0,v1:10.20.193.12:6789/0] conn(0x7f16b010a5e0 0x7f16b0055270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:51.242 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 --2- 10.20.193.12:0/4293734377 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16b01094b0 0x7f16b0054c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T21:18:51.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 >> 10.20.193.12:0/4293734377 conn(0x7f16b00e6b50 msgr2=0x7f16b00e92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T21:18:51.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 shutdown_connections 2026-02-13T21:18:51.243 INFO:teuthology.orchestra.run.trial012.stderr:2026-02-13T21:18:51.239+0000 7f16b4b34640 1 -- 10.20.193.12:0/4293734377 wait complete. 2026-02-13T21:18:51.249 INFO:teuthology.orchestra.run.trial012.stdout:"mds.bar" 2026-02-13T21:18:51.279 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T21:18:51.297 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T21:18:51.298 DEBUG:teuthology.orchestra.run.trial012:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T21:18:51.299 DEBUG:teuthology.orchestra.run.trial090:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T21:18:51.302 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial012.front.sepia.ceph.com 2026-02-13T21:18:51.302 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T21:18:51.302 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T21:18:51.303 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial090.front.sepia.ceph.com 2026-02-13T21:18:51.304 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T21:18:51.304 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T21:18:51.498 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout:Removing: 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli x86_64 2.13-1.el9 @baseos 6.8 M 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:18:51.499 INFO:teuthology.orchestra.run.trial090.stdout:Remove 1 Package 2026-02-13T21:18:51.500 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:51.500 INFO:teuthology.orchestra.run.trial090.stdout:Freed space: 6.8 M 2026-02-13T21:18:51.500 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:18:51.500 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout: Package Architecture Version Repository Size 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout:Removing: 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout: nvme-cli x86_64 2.13-1.el9 @baseos 6.8 M 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout:Remove 1 Package 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:51.501 INFO:teuthology.orchestra.run.trial012.stdout:Freed space: 6.8 M 2026-02-13T21:18:51.502 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:18:51.502 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:18:51.503 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:18:51.503 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:18:51.503 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:18:51.517 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:18:51.517 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:18:51.518 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:18:51.519 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:18:51.561 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:18:51.563 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:18:51.576 INFO:teuthology.orchestra.run.trial090.stdout: Erasing : nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-13T21:18:51.579 INFO:teuthology.orchestra.run.trial012.stdout: Erasing : nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-13T21:18:51.601 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:51 trial012 ceph-mon[37926]: from='client.? 10.20.193.12:0/2997869566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:51.602 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:51 trial090 ceph-mon[42877]: from='client.? 10.20.193.12:0/2997869566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T21:18:51.648 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-13T21:18:51.649 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-13T21:18:51.693 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-13T21:18:51.693 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:51.693 INFO:teuthology.orchestra.run.trial090.stdout:Removed: 2026-02-13T21:18:51.693 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-13T21:18:51.693 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:51.693 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:18:51.694 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-13T21:18:51.694 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:51.694 INFO:teuthology.orchestra.run.trial012.stdout:Removed: 2026-02-13T21:18:51.694 INFO:teuthology.orchestra.run.trial012.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-13T21:18:51.695 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:51.695 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:18:52.011 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:04:12 ago on Fri 13 Feb 2026 09:14:40 PM UTC. 2026-02-13T21:18:52.021 INFO:teuthology.orchestra.run.trial012.stdout:Last metadata expiration check: 0:04:05 ago on Fri 13 Feb 2026 09:14:47 PM UTC. 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout:Upgrading: 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-13T21:18:52.097 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-13T21:18:52.098 INFO:teuthology.orchestra.run.trial090.stdout:Install 5 Packages 2026-02-13T21:18:52.098 INFO:teuthology.orchestra.run.trial090.stdout:Upgrade 1 Package 2026-02-13T21:18:52.098 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:52.098 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 2.3 M 2026-02-13T21:18:52.098 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:Dependencies resolved. 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: Package Architecture Version Repository Size 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:Installing: 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:Upgrading: 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:Installing dependencies: 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:Transaction Summary 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:================================================================================ 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:Install 5 Packages 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout:Upgrade 1 Package 2026-02-13T21:18:52.109 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:52.110 INFO:teuthology.orchestra.run.trial012.stdout:Total download size: 2.3 M 2026-02-13T21:18:52.110 INFO:teuthology.orchestra.run.trial012.stdout:Downloading Packages: 2026-02-13T21:18:52.226 INFO:teuthology.orchestra.run.trial090.stdout:(1/6): nvmetcli-0.8-3.el9.noarch.rpm 3.1 MB/s | 44 kB 00:00 2026-02-13T21:18:52.227 INFO:teuthology.orchestra.run.trial090.stdout:(2/6): python3-configshell-1.1.30-1.el9.noarch. 4.8 MB/s | 72 kB 00:00 2026-02-13T21:18:52.234 INFO:teuthology.orchestra.run.trial090.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 9.9 MB/s | 84 kB 00:00 2026-02-13T21:18:52.240 INFO:teuthology.orchestra.run.trial090.stdout:(4/6): libnvme-1.16.1-2.el9.x86_64.rpm 21 MB/s | 116 kB 00:00 2026-02-13T21:18:52.243 INFO:teuthology.orchestra.run.trial090.stdout:(5/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 49 MB/s | 837 kB 00:00 2026-02-13T21:18:52.245 INFO:teuthology.orchestra.run.trial090.stdout:(6/6): nvme-cli-2.16-1.el9.x86_64.rpm 35 MB/s | 1.2 MB 00:00 2026-02-13T21:18:52.245 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:18:52.245 INFO:teuthology.orchestra.run.trial090.stdout:Total 16 MB/s | 2.3 MB 00:00 2026-02-13T21:18:52.302 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-13T21:18:52.309 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-13T21:18:52.310 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-13T21:18:52.364 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-13T21:18:52.364 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-13T21:18:52.438 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-13T21:18:52.505 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/7 2026-02-13T21:18:52.516 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/7 2026-02-13T21:18:52.521 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-13T21:18:52.527 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-13T21:18:52.528 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-02-13T21:18:52.655 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-02-13T21:18:52.658 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/7 2026-02-13T21:18:52.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:52 trial090 ceph-mon[42877]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "mds", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T21:18:52.670 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:52 trial090 ceph-mon[42877]: pgmap v100: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 8 op/s 2026-02-13T21:18:52.761 INFO:teuthology.orchestra.run.trial012.stdout:(1/6): nvmetcli-0.8-3.el9.noarch.rpm 132 kB/s | 44 kB 00:00 2026-02-13T21:18:52.801 INFO:teuthology.orchestra.run.trial012.stdout:(2/6): python3-configshell-1.1.30-1.el9.noarch. 193 kB/s | 72 kB 00:00 2026-02-13T21:18:52.875 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:52 trial012 ceph-mon[37926]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "mds", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T21:18:52.876 INFO:journalctl@ceph.mon.trial012.trial012.stdout:Feb 13 21:18:52 trial012 ceph-mon[37926]: pgmap v100: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 8 op/s 2026-02-13T21:18:52.945 INFO:teuthology.orchestra.run.trial012.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 459 kB/s | 84 kB 00:00 2026-02-13T21:18:52.982 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/7 2026-02-13T21:18:53.007 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 7/7 2026-02-13T21:18:53.080 INFO:teuthology.orchestra.run.trial012.stdout:(4/6): libnvme-1.16.1-2.el9.x86_64.rpm 857 kB/s | 116 kB 00:00 2026-02-13T21:18:53.145 INFO:teuthology.orchestra.run.trial012.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 1.6 MB/s | 1.2 MB 00:00 2026-02-13T21:18:53.208 INFO:teuthology.orchestra.run.trial012.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 2.0 MB/s | 837 kB 00:00 2026-02-13T21:18:53.208 INFO:teuthology.orchestra.run.trial012.stdout:-------------------------------------------------------------------------------- 2026-02-13T21:18:53.209 INFO:teuthology.orchestra.run.trial012.stdout:Total 2.1 MB/s | 2.3 MB 00:01 2026-02-13T21:18:53.255 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 7/7 2026-02-13T21:18:53.255 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-02-13T21:18:53.255 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-02-13T21:18:53.255 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-13T21:18:53.255 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-13T21:18:53.255 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 5/7 2026-02-13T21:18:53.256 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 6/7 2026-02-13T21:18:53.264 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction check 2026-02-13T21:18:53.272 INFO:teuthology.orchestra.run.trial012.stdout:Transaction check succeeded. 2026-02-13T21:18:53.272 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction test 2026-02-13T21:18:53.313 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libnvme-1.13-1.el9.x86_64 7/7 2026-02-13T21:18:53.313 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:53.314 INFO:teuthology.orchestra.run.trial090.stdout:Upgraded: 2026-02-13T21:18:53.314 INFO:teuthology.orchestra.run.trial090.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T21:18:53.314 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-13T21:18:53.314 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T21:18:53.314 INFO:teuthology.orchestra.run.trial090.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T21:18:53.314 INFO:teuthology.orchestra.run.trial090.stdout: python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T21:18:53.314 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-13T21:18:53.314 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-13T21:18:53.327 INFO:teuthology.orchestra.run.trial012.stdout:Transaction test succeeded. 2026-02-13T21:18:53.327 INFO:teuthology.orchestra.run.trial012.stdout:Running transaction 2026-02-13T21:18:53.345 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:53.403 INFO:teuthology.orchestra.run.trial012.stdout: Preparing : 1/1 2026-02-13T21:18:53.470 INFO:teuthology.orchestra.run.trial012.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/7 2026-02-13T21:18:53.481 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/7 2026-02-13T21:18:53.486 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-13T21:18:53.491 INFO:teuthology.orchestra.run.trial012.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-13T21:18:53.492 INFO:teuthology.orchestra.run.trial012.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-02-13T21:18:53.625 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-02-13T21:18:53.627 INFO:teuthology.orchestra.run.trial012.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/7 2026-02-13T21:18:53.969 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/7 2026-02-13T21:18:53.994 INFO:teuthology.orchestra.run.trial012.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 7/7 2026-02-13T21:18:54.252 INFO:teuthology.orchestra.run.trial012.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 7/7 2026-02-13T21:18:54.252 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-02-13T21:18:54.252 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-02-13T21:18:54.252 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-13T21:18:54.252 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-13T21:18:54.252 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 5/7 2026-02-13T21:18:54.252 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 6/7 2026-02-13T21:18:54.313 INFO:teuthology.orchestra.run.trial012.stdout: Verifying : libnvme-1.13-1.el9.x86_64 7/7 2026-02-13T21:18:54.313 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:54.313 INFO:teuthology.orchestra.run.trial012.stdout:Upgraded: 2026-02-13T21:18:54.313 INFO:teuthology.orchestra.run.trial012.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T21:18:54.313 INFO:teuthology.orchestra.run.trial012.stdout:Installed: 2026-02-13T21:18:54.313 INFO:teuthology.orchestra.run.trial012.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T21:18:54.313 INFO:teuthology.orchestra.run.trial012.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T21:18:54.314 INFO:teuthology.orchestra.run.trial012.stdout: python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T21:18:54.314 INFO:teuthology.orchestra.run.trial012.stdout: 2026-02-13T21:18:54.314 INFO:teuthology.orchestra.run.trial012.stdout:Complete! 2026-02-13T21:18:54.345 DEBUG:teuthology.parallel:result is None 2026-02-13T21:18:54.345 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T21:18:54.361 INFO:tasks.cephadm:Teardown begin 2026-02-13T21:18:54.362 DEBUG:teuthology.orchestra.run.trial012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T21:18:54.391 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T21:18:54.422 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T21:18:54.422 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3551db35-0921-11f1-800a-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T21:18:54.552 INFO:teuthology.orchestra.run.trial012.stderr:Inferring config /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/mon.trial012/config 2026-02-13T21:18:54.571 INFO:teuthology.orchestra.run.trial012.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T21:18:54.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T21:18:54.588 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T21:18:54.589 DEBUG:teuthology.orchestra.run.trial012:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T21:18:54.605 DEBUG:teuthology.orchestra.run.trial090:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T21:18:54.622 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T21:18:54.623 INFO:tasks.cephadm.mon.trial012:Stopping mon.trial012... 2026-02-13T21:18:54.623 DEBUG:teuthology.orchestra.run.trial012:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial012 2026-02-13T21:18:54.892 DEBUG:teuthology.orchestra.run.trial012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial012.service' 2026-02-13T21:18:54.945 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:18:54.945 INFO:tasks.cephadm.mon.trial012:Stopped mon.trial012 2026-02-13T21:18:54.945 INFO:tasks.cephadm.mon.trial090:Stopping mon.trial090... 2026-02-13T21:18:54.946 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial090 2026-02-13T21:18:54.961 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:54 trial090 ceph-mon[42877]: pgmap v101: 65 pgs: 65 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 7 op/s 2026-02-13T21:18:55.232 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:54 trial090 systemd[1]: Stopping Ceph mon.trial090 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:18:55.232 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:55 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial090[42869]: 2026-02-13T21:18:55.051+0000 7f9153d2c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial090 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T21:18:55.233 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:55 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial090[42869]: 2026-02-13T21:18:55.051+0000 7f9153d2c640 -1 mon.trial090@1(peon) e2 *** Got Signal Terminated *** 2026-02-13T21:18:55.233 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:55 trial090 podman[83523]: 2026-02-13 21:18:55.152357078 +0000 UTC m=+0.114108169 container died 2e254abd16b2664bd80f1fa308498372c00221fcd6448a5cb3476cc3b3587d65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial090, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209) 2026-02-13T21:18:55.233 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:55 trial090 podman[83523]: 2026-02-13 21:18:55.162094064 +0000 UTC m=+0.123845155 container remove 2e254abd16b2664bd80f1fa308498372c00221fcd6448a5cb3476cc3b3587d65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial090, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, ceph=True, org.label-schema.build-date=20260209, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T21:18:55.233 INFO:journalctl@ceph.mon.trial090.trial090.stdout:Feb 13 21:18:55 trial090 bash[83523]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-mon-trial090 2026-02-13T21:18:55.253 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@mon.trial090.service' 2026-02-13T21:18:55.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:18:55.346 INFO:tasks.cephadm.mon.trial090:Stopped mon.trial090 2026-02-13T21:18:55.346 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T21:18:55.346 DEBUG:teuthology.orchestra.run.trial012:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.0 2026-02-13T21:18:55.570 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:18:55 trial012 systemd[1]: Stopping Ceph osd.0 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:18:55.570 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:18:55 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0[59144]: 2026-02-13T21:18:55.453+0000 7f8f940d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T21:18:55.570 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:18:55 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0[59144]: 2026-02-13T21:18:55.453+0000 7f8f940d7640 -1 osd.0 57 *** Got signal Terminated *** 2026-02-13T21:18:55.570 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:18:55 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0[59144]: 2026-02-13T21:18:55.453+0000 7f8f940d7640 -1 osd.0 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T21:19:00.845 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 podman[98065]: 2026-02-13 21:19:00.53340576 +0000 UTC m=+5.094039593 container died 3bf78fc4444280b6130ce2471282a0ebfce6f6c814e40508477eecbca19ab1c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=debug, ceph=True) 2026-02-13T21:19:00.846 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 podman[98065]: 2026-02-13 21:19:00.543850675 +0000 UTC m=+5.104484518 container remove 3bf78fc4444280b6130ce2471282a0ebfce6f6c814e40508477eecbca19ab1c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260209, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) 2026-02-13T21:19:00.846 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 bash[98065]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0 2026-02-13T21:19:00.846 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 podman[98469]: 2026-02-13 21:19:00.68259373 +0000 UTC m=+0.016147587 container create ecc5dd63a92c5d508d84e41372f3a5fc7b2ec79e266d6a7a70d4d2a4c3882f76 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0-deactivate, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3) 2026-02-13T21:19:00.846 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 podman[98469]: 2026-02-13 21:19:00.712037351 +0000 UTC m=+0.045591198 container init ecc5dd63a92c5d508d84e41372f3a5fc7b2ec79e266d6a7a70d4d2a4c3882f76 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, ceph=True, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) 2026-02-13T21:19:00.846 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 podman[98469]: 2026-02-13 21:19:00.714550794 +0000 UTC m=+0.048104651 container start ecc5dd63a92c5d508d84e41372f3a5fc7b2ec79e266d6a7a70d4d2a4c3882f76 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, io.buildah.version=1.41.3, org.label-schema.build-date=20260209, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0) 2026-02-13T21:19:00.846 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 podman[98469]: 2026-02-13 21:19:00.715037819 +0000 UTC m=+0.048591666 container attach ecc5dd63a92c5d508d84e41372f3a5fc7b2ec79e266d6a7a70d4d2a4c3882f76 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.build-date=20260209, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0) 2026-02-13T21:19:00.846 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 podman[98469]: 2026-02-13 21:19:00.676154701 +0000 UTC m=+0.009708538 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 2026-02-13T21:19:00.846 INFO:journalctl@ceph.osd.0.trial012.stdout:Feb 13 21:19:00 trial012 podman[98469]: 2026-02-13 21:19:00.843120798 +0000 UTC m=+0.176674635 container died ecc5dd63a92c5d508d84e41372f3a5fc7b2ec79e266d6a7a70d4d2a4c3882f76 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-0-deactivate, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2) 2026-02-13T21:19:00.872 DEBUG:teuthology.orchestra.run.trial012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.0.service' 2026-02-13T21:19:00.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:19:00.920 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T21:19:00.920 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T21:19:00.920 DEBUG:teuthology.orchestra.run.trial012:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.1 2026-02-13T21:19:01.126 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:00 trial012 systemd[1]: Stopping Ceph osd.1 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:19:01.126 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:01 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1[65255]: 2026-02-13T21:19:01.016+0000 7fb1b9776640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T21:19:01.126 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:01 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1[65255]: 2026-02-13T21:19:01.016+0000 7fb1b9776640 -1 osd.1 57 *** Got signal Terminated *** 2026-02-13T21:19:01.126 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:01 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1[65255]: 2026-02-13T21:19:01.016+0000 7fb1b9776640 -1 osd.1 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T21:19:06.376 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:06 trial012 podman[98606]: 2026-02-13 21:19:06.0865556 +0000 UTC m=+5.082629619 container died 17be252787f882a4b1566c0d75fa6dfd8ddbe6fd5388080d243c5e62de30451d (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, OSD_FLAVOR=debug, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260209, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T21:19:06.376 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:06 trial012 podman[98606]: 2026-02-13 21:19:06.095772132 +0000 UTC m=+5.091846151 container remove 17be252787f882a4b1566c0d75fa6dfd8ddbe6fd5388080d243c5e62de30451d (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1, io.buildah.version=1.41.3, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T21:19:06.376 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:06 trial012 bash[98606]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1 2026-02-13T21:19:06.376 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:06 trial012 podman[98738]: 2026-02-13 21:19:06.231617329 +0000 UTC m=+0.016477591 container create ece73568cd65313b8a00a056f47a764f4e6777f0877bf1cde55747afa9531ee9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260209, OSD_FLAVOR=debug, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-13T21:19:06.377 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:06 trial012 podman[98738]: 2026-02-13 21:19:06.256104758 +0000 UTC m=+0.040964979 container init ece73568cd65313b8a00a056f47a764f4e6777f0877bf1cde55747afa9531ee9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260209, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2026-02-13T21:19:06.377 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:06 trial012 podman[98738]: 2026-02-13 21:19:06.25854225 +0000 UTC m=+0.043402471 container start ece73568cd65313b8a00a056f47a764f4e6777f0877bf1cde55747afa9531ee9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1-deactivate, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.schema-version=1.0) 2026-02-13T21:19:06.377 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:06 trial012 podman[98738]: 2026-02-13 21:19:06.25909652 +0000 UTC m=+0.043956731 container attach ece73568cd65313b8a00a056f47a764f4e6777f0877bf1cde55747afa9531ee9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, OSD_FLAVOR=debug, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260209) 2026-02-13T21:19:06.377 INFO:journalctl@ceph.osd.1.trial012.stdout:Feb 13 21:19:06 trial012 podman[98738]: 2026-02-13 21:19:06.225219186 +0000 UTC m=+0.010079407 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 2026-02-13T21:19:06.424 DEBUG:teuthology.orchestra.run.trial012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.1.service' 2026-02-13T21:19:06.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:19:06.472 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T21:19:06.472 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T21:19:06.472 DEBUG:teuthology.orchestra.run.trial012:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.2 2026-02-13T21:19:06.875 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:06 trial012 systemd[1]: Stopping Ceph osd.2 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:19:06.875 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:06 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2[71274]: 2026-02-13T21:19:06.567+0000 7f23d447a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T21:19:06.875 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:06 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2[71274]: 2026-02-13T21:19:06.567+0000 7f23d447a640 -1 osd.2 57 *** Got signal Terminated *** 2026-02-13T21:19:06.876 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:06 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2[71274]: 2026-02-13T21:19:06.567+0000 7f23d447a640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 podman[98877]: 2026-02-13 21:19:11.62622114 +0000 UTC m=+5.071204857 container died ba65e7371d795396c8ab97902cb3a78a13270e1a503f54f311633c868430e35a (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 podman[98877]: 2026-02-13 21:19:11.635954233 +0000 UTC m=+5.080937950 container remove ba65e7371d795396c8ab97902cb3a78a13270e1a503f54f311633c868430e35a (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug) 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 bash[98877]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 podman[99014]: 2026-02-13 21:19:11.766111247 +0000 UTC m=+0.015884067 container create 3502bdc19e387fa481ccd47320e3c5043488cbbe5c21628da3af6b25cb3a92c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2-deactivate, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, OSD_FLAVOR=debug, org.label-schema.build-date=20260209, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, ceph=True, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 podman[99014]: 2026-02-13 21:19:11.800165509 +0000 UTC m=+0.049938259 container init 3502bdc19e387fa481ccd47320e3c5043488cbbe5c21628da3af6b25cb3a92c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.build-date=20260209, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS) 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 podman[99014]: 2026-02-13 21:19:11.803030104 +0000 UTC m=+0.052802854 container start 3502bdc19e387fa481ccd47320e3c5043488cbbe5c21628da3af6b25cb3a92c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260209, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 podman[99014]: 2026-02-13 21:19:11.80345256 +0000 UTC m=+0.053225310 container attach 3502bdc19e387fa481ccd47320e3c5043488cbbe5c21628da3af6b25cb3a92c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260209, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, ceph=True) 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 podman[99014]: 2026-02-13 21:19:11.759993856 +0000 UTC m=+0.009766606 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 2026-02-13T21:19:11.926 INFO:journalctl@ceph.osd.2.trial012.stdout:Feb 13 21:19:11 trial012 podman[99014]: 2026-02-13 21:19:11.924418979 +0000 UTC m=+0.174191730 container died 3502bdc19e387fa481ccd47320e3c5043488cbbe5c21628da3af6b25cb3a92c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-2-deactivate, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, org.label-schema.build-date=20260209, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T21:19:11.958 DEBUG:teuthology.orchestra.run.trial012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.2.service' 2026-02-13T21:19:12.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:19:12.006 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T21:19:12.006 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T21:19:12.006 DEBUG:teuthology.orchestra.run.trial012:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.3 2026-02-13T21:19:12.376 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:12 trial012 systemd[1]: Stopping Ceph osd.3 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:19:12.376 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:12 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3[77345]: 2026-02-13T21:19:12.099+0000 7fb494f23640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T21:19:12.376 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:12 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3[77345]: 2026-02-13T21:19:12.099+0000 7fb494f23640 -1 osd.3 57 *** Got signal Terminated *** 2026-02-13T21:19:12.376 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:12 trial012 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3[77345]: 2026-02-13T21:19:12.099+0000 7fb494f23640 -1 osd.3 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T21:19:17.463 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:17 trial012 podman[99152]: 2026-02-13 21:19:17.168443376 +0000 UTC m=+5.082006769 container died 54216cd373d6387c55660421e0934d989ea8c5cd497c3ee3da5f1c694bc80b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) 2026-02-13T21:19:17.464 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:17 trial012 podman[99152]: 2026-02-13 21:19:17.176988059 +0000 UTC m=+5.090551452 container remove 54216cd373d6387c55660421e0934d989ea8c5cd497c3ee3da5f1c694bc80b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0) 2026-02-13T21:19:17.464 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:17 trial012 bash[99152]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3 2026-02-13T21:19:17.464 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:17 trial012 podman[99287]: 2026-02-13 21:19:17.312640318 +0000 UTC m=+0.016368097 container create 1a29dabbb65bcd9c88f581a1f9a56e30359159c81dbcefa4cf33f7820ed2775a (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3-deactivate, org.label-schema.vendor=CentOS, OSD_FLAVOR=debug, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260209, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) 2026-02-13T21:19:17.464 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:17 trial012 podman[99287]: 2026-02-13 21:19:17.340005607 +0000 UTC m=+0.043733396 container init 1a29dabbb65bcd9c88f581a1f9a56e30359159c81dbcefa4cf33f7820ed2775a (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.build-date=20260209) 2026-02-13T21:19:17.464 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:17 trial012 podman[99287]: 2026-02-13 21:19:17.342611491 +0000 UTC m=+0.046339270 container start 1a29dabbb65bcd9c88f581a1f9a56e30359159c81dbcefa4cf33f7820ed2775a (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, ceph=True, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-13T21:19:17.464 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:17 trial012 podman[99287]: 2026-02-13 21:19:17.343351757 +0000 UTC m=+0.047079536 container attach 1a29dabbb65bcd9c88f581a1f9a56e30359159c81dbcefa4cf33f7820ed2775a (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T21:19:17.464 INFO:journalctl@ceph.osd.3.trial012.stdout:Feb 13 21:19:17 trial012 podman[99287]: 2026-02-13 21:19:17.306434603 +0000 UTC m=+0.010162392 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 2026-02-13T21:19:17.498 DEBUG:teuthology.orchestra.run.trial012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.3.service' 2026-02-13T21:19:17.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:19:17.546 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T21:19:17.546 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T21:19:17.547 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.4 2026-02-13T21:19:18.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:17 trial090 systemd[1]: Stopping Ceph osd.4 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:19:18.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:17 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4[49885]: 2026-02-13T21:19:17.647+0000 7f3dc714d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T21:19:18.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:17 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4[49885]: 2026-02-13T21:19:17.647+0000 7f3dc714d640 -1 osd.4 57 *** Got signal Terminated *** 2026-02-13T21:19:18.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:17 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4[49885]: 2026-02-13T21:19:17.647+0000 7f3dc714d640 -1 osd.4 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T21:19:21.022 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:20 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:20.767+0000 7f4fb30b7640 -1 osd.5 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.474888+0000 front 2026-02-13T21:18:56.474960+0000 (oldest deadline 2026-02-13T21:19:20.574855+0000) 2026-02-13T21:19:22.022 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:21 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:21.763+0000 7f4fb30b7640 -1 osd.5 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.474888+0000 front 2026-02-13T21:18:56.474960+0000 (oldest deadline 2026-02-13T21:19:20.574855+0000) 2026-02-13T21:19:22.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:21 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4[49885]: 2026-02-13T21:19:21.698+0000 7f3dbef1b640 -1 osd.4 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.973258+0000 front 2026-02-13T21:18:56.973400+0000 (oldest deadline 2026-02-13T21:19:21.673351+0000) 2026-02-13T21:19:22.023 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:21 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:21.852+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:23.020 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:22 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:22.871+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:23.020 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:22 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:22.808+0000 7f4fb30b7640 -1 osd.5 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.474888+0000 front 2026-02-13T21:18:56.474960+0000 (oldest deadline 2026-02-13T21:19:20.574855+0000) 2026-02-13T21:19:23.021 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:22 trial090 podman[84005]: 2026-02-13 21:19:22.716896587 +0000 UTC m=+5.081390294 container died 0d3fef1e2c01c8b5b1e6085a8e2214b1c0e559b54dbbc698b12a2a6880d728e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4, org.label-schema.build-date=20260209, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, OSD_FLAVOR=debug, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T21:19:23.021 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:22 trial090 podman[84005]: 2026-02-13 21:19:22.725915348 +0000 UTC m=+5.090409055 container remove 0d3fef1e2c01c8b5b1e6085a8e2214b1c0e559b54dbbc698b12a2a6880d728e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260209, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, OSD_FLAVOR=debug) 2026-02-13T21:19:23.021 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:22 trial090 bash[84005]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4 2026-02-13T21:19:23.021 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:22 trial090 podman[84135]: 2026-02-13 21:19:22.856277753 +0000 UTC m=+0.016602965 container create a6e21ee553ccf4921ab8b0b4aa765d9f40acca112f1492eb9d8dfd9d0ecc3b42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4-deactivate, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.build-date=20260209) 2026-02-13T21:19:23.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:22 trial090 podman[84135]: 2026-02-13 21:19:22.889801414 +0000 UTC m=+0.050126606 container init a6e21ee553ccf4921ab8b0b4aa765d9f40acca112f1492eb9d8dfd9d0ecc3b42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, ceph=True, OSD_FLAVOR=debug, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-13T21:19:23.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:22 trial090 podman[84135]: 2026-02-13 21:19:22.892310266 +0000 UTC m=+0.052635458 container start a6e21ee553ccf4921ab8b0b4aa765d9f40acca112f1492eb9d8dfd9d0ecc3b42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4-deactivate, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260209) 2026-02-13T21:19:23.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:22 trial090 podman[84135]: 2026-02-13 21:19:22.892875998 +0000 UTC m=+0.053201190 container attach a6e21ee553ccf4921ab8b0b4aa765d9f40acca112f1492eb9d8dfd9d0ecc3b42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4-deactivate, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T21:19:23.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:22 trial090 podman[84135]: 2026-02-13 21:19:22.849379193 +0000 UTC m=+0.009704395 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 2026-02-13T21:19:23.022 INFO:journalctl@ceph.osd.4.trial090.stdout:Feb 13 21:19:23 trial090 podman[84135]: 2026-02-13 21:19:23.019447859 +0000 UTC m=+0.179773051 container died a6e21ee553ccf4921ab8b0b4aa765d9f40acca112f1492eb9d8dfd9d0ecc3b42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-4-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=debug, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20260209, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle) 2026-02-13T21:19:23.054 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.4.service' 2026-02-13T21:19:23.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:19:23.103 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T21:19:23.103 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T21:19:23.103 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.5 2026-02-13T21:19:23.272 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:23 trial090 systemd[1]: Stopping Ceph osd.5 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:19:23.272 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:23 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:23.201+0000 7f4fb72e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T21:19:23.272 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:23 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:23.201+0000 7f4fb72e1640 -1 osd.5 57 *** Got signal Terminated *** 2026-02-13T21:19:23.272 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:23 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:23.201+0000 7f4fb72e1640 -1 osd.5 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T21:19:24.272 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:23 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:23.773+0000 7f4fb30b7640 -1 osd.5 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.474888+0000 front 2026-02-13T21:18:56.474960+0000 (oldest deadline 2026-02-13T21:19:20.574855+0000) 2026-02-13T21:19:24.272 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:23 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:23.830+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:25.022 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:24 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:24.741+0000 7f4fb30b7640 -1 osd.5 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.474888+0000 front 2026-02-13T21:18:56.474960+0000 (oldest deadline 2026-02-13T21:19:20.574855+0000) 2026-02-13T21:19:25.022 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:24 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:24.793+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:26.022 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:25 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:25.766+0000 7f4fb30b7640 -1 osd.5 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.474888+0000 front 2026-02-13T21:18:56.474960+0000 (oldest deadline 2026-02-13T21:19:20.574855+0000) 2026-02-13T21:19:26.022 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:25 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:25.814+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:26.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:26 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:26.162+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:26.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:26 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:26.162+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:27.022 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:26 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:26.747+0000 7f4fb30b7640 -1 osd.5 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.474888+0000 front 2026-02-13T21:18:56.474960+0000 (oldest deadline 2026-02-13T21:19:20.574855+0000) 2026-02-13T21:19:27.022 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:26 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:26.836+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:27.521 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:27 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:27.176+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:27.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:27 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:27.176+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:28.021 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:27 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5[56751]: 2026-02-13T21:19:27.740+0000 7f4fb30b7640 -1 osd.5 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:56.474888+0000 front 2026-02-13T21:18:56.474960+0000 (oldest deadline 2026-02-13T21:19:20.574855+0000) 2026-02-13T21:19:28.022 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:27 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:27.877+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:28.491 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:28 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:28.212+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:28.492 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:28 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:28.212+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:28.492 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:28 trial090 podman[84268]: 2026-02-13 21:19:28.261360193 +0000 UTC m=+5.071737000 container died 9f8f63d55fd55e540accfea18aedacdd26ee7f8192ef25dca4382488cc30c25c (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=debug, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T21:19:28.493 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:28 trial090 podman[84268]: 2026-02-13 21:19:28.270273768 +0000 UTC m=+5.080650585 container remove 9f8f63d55fd55e540accfea18aedacdd26ee7f8192ef25dca4382488cc30c25c (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, OSD_FLAVOR=debug, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T21:19:28.493 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:28 trial090 bash[84268]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5 2026-02-13T21:19:28.493 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:28 trial090 podman[84402]: 2026-02-13 21:19:28.398446865 +0000 UTC m=+0.015523049 container create c6375d06e815a9feef4a13cf705fefd7843907bb56af3f3cc77d16206fc65fa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-02-13T21:19:28.493 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:28 trial090 podman[84402]: 2026-02-13 21:19:28.426635341 +0000 UTC m=+0.043711515 container init c6375d06e815a9feef4a13cf705fefd7843907bb56af3f3cc77d16206fc65fa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=debug, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.build-date=20260209, ceph=True, io.buildah.version=1.41.3, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T21:19:28.493 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:28 trial090 podman[84402]: 2026-02-13 21:19:28.429150986 +0000 UTC m=+0.046227170 container start c6375d06e815a9feef4a13cf705fefd7843907bb56af3f3cc77d16206fc65fa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5-deactivate, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.build-date=20260209, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T21:19:28.493 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:28 trial090 podman[84402]: 2026-02-13 21:19:28.429592606 +0000 UTC m=+0.046668780 container attach c6375d06e815a9feef4a13cf705fefd7843907bb56af3f3cc77d16206fc65fa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-5-deactivate, io.buildah.version=1.41.3, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True) 2026-02-13T21:19:28.494 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 13 21:19:28 trial090 podman[84402]: 2026-02-13 21:19:28.392088609 +0000 UTC m=+0.009164783 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 2026-02-13T21:19:28.610 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.5.service' 2026-02-13T21:19:28.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:19:28.657 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T21:19:28.657 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T21:19:28.658 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.6 2026-02-13T21:19:28.756 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:28 trial090 systemd[1]: Stopping Ceph osd.6 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:19:28.756 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:28 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:28.753+0000 7f4dae328640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T21:19:28.756 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:28 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:28.753+0000 7f4dae328640 -1 osd.6 57 *** Got signal Terminated *** 2026-02-13T21:19:28.756 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:28 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:28.753+0000 7f4dae328640 -1 osd.6 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T21:19:29.022 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:28 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:28.845+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:29.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:29 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:29.226+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:29.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:29 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:29.226+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:30.188 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:29 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:29.799+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:30.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:30 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:30.186+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:30.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:30 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:30.186+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:31.209 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:30 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:30.825+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:31.209 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:30 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:30.825+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:04.687862+0000 front 2026-02-13T21:19:04.687843+0000 (oldest deadline 2026-02-13T21:19:29.987902+0000) 2026-02-13T21:19:31.521 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:31 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:31.208+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:31.521 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:31 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:31.208+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:32.251 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:31 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:31.796+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:32.252 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:31 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:31.796+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:04.687862+0000 front 2026-02-13T21:19:04.687843+0000 (oldest deadline 2026-02-13T21:19:29.987902+0000) 2026-02-13T21:19:32.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:32 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:32.250+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:32.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:32 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:32.250+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:33.210 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:32 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:32.799+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:18:55.287540+0000 front 2026-02-13T21:18:55.287606+0000 (oldest deadline 2026-02-13T21:19:21.187460+0000) 2026-02-13T21:19:33.210 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:32 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6[62535]: 2026-02-13T21:19:32.799+0000 7f4daa0fe640 -1 osd.6 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:04.687862+0000 front 2026-02-13T21:19:04.687843+0000 (oldest deadline 2026-02-13T21:19:29.987902+0000) 2026-02-13T21:19:33.521 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:33 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:33.208+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:33.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:33 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:33.208+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:33.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:33 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:33.208+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6822 osd.2 since back 2026-02-13T21:19:08.396585+0000 front 2026-02-13T21:19:08.396518+0000 (oldest deadline 2026-02-13T21:19:32.496470+0000) 2026-02-13T21:19:34.121 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:33 trial090 podman[84534]: 2026-02-13 21:19:33.812994523 +0000 UTC m=+5.071839629 container died 2ed096c9c4ee24ce280547fdfa31483ab3bb211048bd5e041c297b926651ca7f (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.license=GPLv2, OSD_FLAVOR=debug, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-13T21:19:34.121 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:33 trial090 podman[84534]: 2026-02-13 21:19:33.821747319 +0000 UTC m=+5.080592425 container remove 2ed096c9c4ee24ce280547fdfa31483ab3bb211048bd5e041c297b926651ca7f (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20260209, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.label-schema.license=GPLv2, io.buildah.version=1.41.3) 2026-02-13T21:19:34.122 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:33 trial090 bash[84534]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6 2026-02-13T21:19:34.122 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:33 trial090 podman[84663]: 2026-02-13 21:19:33.956898284 +0000 UTC m=+0.015821233 container create 789fdace1190cf84a4e2512f53dc13a2a4fea51f0e472f90516953cfcc029273 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33) 2026-02-13T21:19:34.122 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:33 trial090 podman[84663]: 2026-02-13 21:19:33.992736255 +0000 UTC m=+0.051659194 container init 789fdace1190cf84a4e2512f53dc13a2a4fea51f0e472f90516953cfcc029273 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6-deactivate, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260209, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=debug, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-13T21:19:34.122 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:33 trial090 podman[84663]: 2026-02-13 21:19:33.99502589 +0000 UTC m=+0.053948849 container start 789fdace1190cf84a4e2512f53dc13a2a4fea51f0e472f90516953cfcc029273 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, ceph=True, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle) 2026-02-13T21:19:34.122 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:33 trial090 podman[84663]: 2026-02-13 21:19:33.99560694 +0000 UTC m=+0.054529879 container attach 789fdace1190cf84a4e2512f53dc13a2a4fea51f0e472f90516953cfcc029273 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6-deactivate, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260209, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0) 2026-02-13T21:19:34.122 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:34 trial090 podman[84663]: 2026-02-13 21:19:33.950858009 +0000 UTC m=+0.009780958 image pull c6f9d1e4efcbd4a193d592bf6bdb15de19202193574e60a56ec18739ea9e5185 quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06 2026-02-13T21:19:34.122 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 13 21:19:34 trial090 podman[84663]: 2026-02-13 21:19:34.120234058 +0000 UTC m=+0.179157007 container died 789fdace1190cf84a4e2512f53dc13a2a4fea51f0e472f90516953cfcc029273 (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-6-deactivate, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=debug, org.label-schema.build-date=20260209, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T21:19:34.150 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.6.service' 2026-02-13T21:19:34.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:19:34.198 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T21:19:34.199 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T21:19:34.199 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.7 2026-02-13T21:19:34.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:34 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:34.188+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:34.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:34 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:34.188+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:34.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:34 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:34.188+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6822 osd.2 since back 2026-02-13T21:19:08.396585+0000 front 2026-02-13T21:19:08.396518+0000 (oldest deadline 2026-02-13T21:19:32.496470+0000) 2026-02-13T21:19:34.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:34 trial090 systemd[1]: Stopping Ceph osd.7 for 3551db35-0921-11f1-800a-d404e6e7d460... 2026-02-13T21:19:34.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:34 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:34.292+0000 7f0db2136640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T21:19:34.523 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:34 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:34.292+0000 7f0db2136640 -1 osd.7 57 *** Got signal Terminated *** 2026-02-13T21:19:34.523 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:34 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:34.292+0000 7f0db2136640 -1 osd.7 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T21:19:35.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:35 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:35.165+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:35.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:35 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:35.165+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:35.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:35 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:35.165+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6822 osd.2 since back 2026-02-13T21:19:08.396585+0000 front 2026-02-13T21:19:08.396518+0000 (oldest deadline 2026-02-13T21:19:32.496470+0000) 2026-02-13T21:19:36.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:36 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:36.139+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:36.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:36 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:36.139+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:36.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:36 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:36.139+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6822 osd.2 since back 2026-02-13T21:19:08.396585+0000 front 2026-02-13T21:19:08.396518+0000 (oldest deadline 2026-02-13T21:19:32.496470+0000) 2026-02-13T21:19:37.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:37 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:37.149+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:37.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:37 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:37.149+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:37.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:37 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:37.149+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6822 osd.2 since back 2026-02-13T21:19:08.396585+0000 front 2026-02-13T21:19:08.396518+0000 (oldest deadline 2026-02-13T21:19:32.496470+0000) 2026-02-13T21:19:38.521 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:38 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:38.124+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:38.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:38 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:38.124+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:38.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:38 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:38.124+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6822 osd.2 since back 2026-02-13T21:19:08.396585+0000 front 2026-02-13T21:19:08.396518+0000 (oldest deadline 2026-02-13T21:19:32.496470+0000) 2026-02-13T21:19:38.522 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:38 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:38.124+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6830 osd.3 since back 2026-02-13T21:19:12.496766+0000 front 2026-02-13T21:19:12.496812+0000 (oldest deadline 2026-02-13T21:19:37.196724+0000) 2026-02-13T21:19:39.379 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:39 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:39.125+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6806 osd.0 since back 2026-02-13T21:19:00.196024+0000 front 2026-02-13T21:19:00.196039+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:39.380 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:39 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:39.125+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6814 osd.1 since back 2026-02-13T21:19:00.196208+0000 front 2026-02-13T21:19:00.196065+0000 (oldest deadline 2026-02-13T21:19:26.096082+0000) 2026-02-13T21:19:39.380 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:39 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:39.125+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6822 osd.2 since back 2026-02-13T21:19:08.396585+0000 front 2026-02-13T21:19:08.396518+0000 (oldest deadline 2026-02-13T21:19:32.496470+0000) 2026-02-13T21:19:39.380 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:39 trial090 ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7[69268]: 2026-02-13T21:19:39.125+0000 7f0da9f04640 -1 osd.7 57 heartbeat_check: no reply from 10.20.193.12:6830 osd.3 since back 2026-02-13T21:19:12.496766+0000 front 2026-02-13T21:19:12.496812+0000 (oldest deadline 2026-02-13T21:19:37.196724+0000) 2026-02-13T21:19:39.380 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:39 trial090 podman[84803]: 2026-02-13 21:19:39.352843804 +0000 UTC m=+5.072235518 container died 82df21c7c5f6becfadea14158f39119b33cccfc26a82e882a78b3df52095bcaf (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=debug, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260209, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-13T21:19:39.380 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:39 trial090 podman[84803]: 2026-02-13 21:19:39.36226347 +0000 UTC m=+5.081655184 container remove 82df21c7c5f6becfadea14158f39119b33cccfc26a82e882a78b3df52095bcaf (image=quay.ceph.io/ceph-ci/ceph@sha256:f5b590aac0388f05d825043f21e1c2b16e35c6d02074b72884280bae8e887c06, name=ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260213.155635-tentacle, ceph=True, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=3baf6bae4dcbc38f3b44b2d18f0dce2ebaeebf33, OSD_FLAVOR=debug, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-13T21:19:39.380 INFO:journalctl@ceph.osd.7.trial090.stdout:Feb 13 21:19:39 trial090 bash[84803]: ceph-3551db35-0921-11f1-800a-d404e6e7d460-osd-7 2026-02-13T21:19:39.686 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3551db35-0921-11f1-800a-d404e6e7d460@osd.7.service' 2026-02-13T21:19:39.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T21:19:39.732 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T21:19:39.732 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3551db35-0921-11f1-800a-d404e6e7d460 --force --keep-logs 2026-02-13T21:19:39.853 INFO:teuthology.orchestra.run.trial012.stdout:Deleting cluster with fsid: 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:19:44.504 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3551db35-0921-11f1-800a-d404e6e7d460 --force --keep-logs 2026-02-13T21:19:44.625 INFO:teuthology.orchestra.run.trial090.stdout:Deleting cluster with fsid: 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:19:55.169 DEBUG:teuthology.orchestra.run.trial012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T21:19:55.199 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T21:19:55.227 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T21:19:55.230 DEBUG:teuthology.misc:Transferring archived files from trial012:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085/remote/trial012/crash 2026-02-13T21:19:55.231 DEBUG:teuthology.orchestra.run.trial012:> sudo tar c -f - -C /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/crash -- . 2026-02-13T21:19:55.263 INFO:teuthology.orchestra.run.trial012.stderr:tar: /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T21:19:55.263 INFO:teuthology.orchestra.run.trial012.stderr:tar: Error is not recoverable: exiting now 2026-02-13T21:19:55.266 DEBUG:teuthology.misc:Transferring archived files from trial090:/var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085/remote/trial090/crash 2026-02-13T21:19:55.267 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/crash -- . 2026-02-13T21:19:55.292 INFO:teuthology.orchestra.run.trial090.stderr:tar: /var/lib/ceph/3551db35-0921-11f1-800a-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T21:19:55.292 INFO:teuthology.orchestra.run.trial090.stderr:tar: Error is not recoverable: exiting now 2026-02-13T21:19:55.293 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T21:19:55.293 DEBUG:teuthology.orchestra.run.trial012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v BLUESTORE_SLOW_OP_ALERT | egrep -v 'slow operation indications in BlueStore' | egrep -v 'experiencing slow operations in BlueStore' | egrep -v MGR_MODULE_ERROR | egrep -v OSD_DOWN | egrep -v 'osd.* is down' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-13T21:19:55.331 INFO:tasks.cephadm:Compressing logs... 2026-02-13T21:19:55.331 DEBUG:teuthology.orchestra.run.trial012:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T21:19:55.373 DEBUG:teuthology.orchestra.run.trial090:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T21:19:55.398 INFO:teuthology.orchestra.run.trial012.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2026-02-13T21:19:55.398 INFO:teuthology.orchestra.run.trial012.stderr: -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T21:19:55.398 INFO:teuthology.orchestra.run.trial012.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.2.log 2026-02-13T21:19:55.398 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.foo.trial012.ebqplc.log 2026-02-13T21:19:55.398 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.bar.trial012.ffjxty.log 2026-02-13T21:19:55.398 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.foo.trial012.ebqplc.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.0.log 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-client.ceph-exporter.trial012.log 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.bar.trial012.ffjxty.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.3.log 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.0.log: /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-client.ceph-exporter.trial012.log: 89.8% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.foo.trial012.ebqplc.log.gz 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.cephadm.log 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr: 90.9% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-client.ceph-exporter.trial012.log.gz 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mon.trial012.log 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.3.log: /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.audit.log 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr: 94.1% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.bar.trial012.ffjxty.log.gz 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mon.trial012.log: 85.0% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T21:19:55.399 INFO:teuthology.orchestra.run.trial012.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mgr.trial012.zqhrrq.log 2026-02-13T21:19:55.400 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-volume.log 2026-02-13T21:19:55.400 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mgr.trial012.zqhrrq.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.1.log 2026-02-13T21:19:55.400 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.log 2026-02-13T21:19:55.401 INFO:teuthology.orchestra.run.trial012.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.1.log: /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.log: 91.0% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.audit.log.gz 2026-02-13T21:19:55.401 INFO:teuthology.orchestra.run.trial012.stderr: 84.4% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.log.gz 2026-02-13T21:19:55.406 INFO:teuthology.orchestra.run.trial090.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T21:19:55.406 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T21:19:55.406 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.bar.trial090.sdpumd.log 2026-02-13T21:19:55.406 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.5.log 2026-02-13T21:19:55.406 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.7.log 2026-02-13T21:19:55.406 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.bar.trial090.sdpumd.log: /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.foo.trial090.ppgikq.log 2026-02-13T21:19:55.406 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.cephadm.log 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.foo.trial090.ppgikq.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mgr.trial090.qsdrej.log 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.4.log 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr: 85.2% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.audit.log 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mgr.trial090.qsdrej.log: /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-volume.log 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-client.ceph-exporter.trial090.log 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.6.log 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mon.trial090.log 2026-02-13T21:19:55.407 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-client.ceph-exporter.trial090.log: 90.3% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-client.ceph-exporter.trial090.log.gz 2026-02-13T21:19:55.408 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.6.log: 91.2% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.audit.log.gz 2026-02-13T21:19:55.408 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.log 2026-02-13T21:19:55.408 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mon.trial090.log: /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.log: 83.9% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph.log.gz 2026-02-13T21:19:55.408 INFO:teuthology.orchestra.run.trial090.stderr: 93.2% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.bar.trial090.sdpumd.log.gz 2026-02-13T21:19:55.408 INFO:teuthology.orchestra.run.trial090.stderr: 91.0% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mgr.trial090.qsdrej.log.gz 2026-02-13T21:19:55.408 INFO:teuthology.orchestra.run.trial090.stderr: 90.2% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mds.foo.trial090.ppgikq.log.gz 2026-02-13T21:19:55.408 INFO:teuthology.orchestra.run.trial012.stderr: 95.3% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-volume.log.gz 2026-02-13T21:19:55.410 INFO:teuthology.orchestra.run.trial012.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T21:19:55.412 INFO:teuthology.orchestra.run.trial090.stderr: 95.5% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-volume.log.gz 2026-02-13T21:19:55.424 INFO:teuthology.orchestra.run.trial012.stderr: 93.2% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T21:19:55.427 INFO:teuthology.orchestra.run.trial012.stderr: 93.2% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T21:19:55.430 INFO:teuthology.orchestra.run.trial090.stderr: 93.1% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T21:19:55.433 INFO:teuthology.orchestra.run.trial012.stderr: 93.3% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T21:19:55.434 INFO:teuthology.orchestra.run.trial090.stderr: 93.2% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T21:19:55.438 INFO:teuthology.orchestra.run.trial090.stderr: 93.1% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T21:19:55.438 INFO:teuthology.orchestra.run.trial090.stderr: 92.4% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mon.trial090.log.gz 2026-02-13T21:19:55.438 INFO:teuthology.orchestra.run.trial090.stderr: 93.5% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T21:19:55.439 INFO:teuthology.orchestra.run.trial090.stderr: 2026-02-13T21:19:55.439 INFO:teuthology.orchestra.run.trial090.stderr:real 0m0.050s 2026-02-13T21:19:55.439 INFO:teuthology.orchestra.run.trial090.stderr:user 0m0.189s 2026-02-13T21:19:55.440 INFO:teuthology.orchestra.run.trial090.stderr:sys 0m0.035s 2026-02-13T21:19:55.447 INFO:teuthology.orchestra.run.trial012.stderr: 93.4% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T21:19:55.467 INFO:teuthology.orchestra.run.trial012.stderr: 89.8% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mgr.trial012.zqhrrq.log.gz 2026-02-13T21:19:55.518 INFO:teuthology.orchestra.run.trial012.stderr: 91.6% -- replaced with /var/log/ceph/3551db35-0921-11f1-800a-d404e6e7d460/ceph-mon.trial012.log.gz 2026-02-13T21:19:55.520 INFO:teuthology.orchestra.run.trial012.stderr: 2026-02-13T21:19:55.521 INFO:teuthology.orchestra.run.trial012.stderr:real 0m0.135s 2026-02-13T21:19:55.521 INFO:teuthology.orchestra.run.trial012.stderr:user 0m0.351s 2026-02-13T21:19:55.521 INFO:teuthology.orchestra.run.trial012.stderr:sys 0m0.045s 2026-02-13T21:19:55.521 INFO:tasks.cephadm:Archiving logs... 2026-02-13T21:19:55.522 DEBUG:teuthology.misc:Transferring archived files from trial012:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085/remote/trial012/log 2026-02-13T21:19:55.523 DEBUG:teuthology.orchestra.run.trial012:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T21:19:55.702 DEBUG:teuthology.misc:Transferring archived files from trial090:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085/remote/trial090/log 2026-02-13T21:19:55.703 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T21:19:55.778 INFO:tasks.cephadm:Removing cluster... 2026-02-13T21:19:55.778 DEBUG:teuthology.orchestra.run.trial012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3551db35-0921-11f1-800a-d404e6e7d460 --force 2026-02-13T21:19:55.901 INFO:teuthology.orchestra.run.trial012.stdout:Deleting cluster with fsid: 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:19:56.064 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3551db35-0921-11f1-800a-d404e6e7d460 --force 2026-02-13T21:19:56.184 INFO:teuthology.orchestra.run.trial090.stdout:Deleting cluster with fsid: 3551db35-0921-11f1-800a-d404e6e7d460 2026-02-13T21:19:56.340 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T21:19:56.340 DEBUG:teuthology.orchestra.run.trial012:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T21:19:56.359 DEBUG:teuthology.orchestra.run.trial090:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T21:19:56.376 INFO:tasks.cephadm:Teardown complete 2026-02-13T21:19:56.376 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T21:19:56.393 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T21:19:56.393 DEBUG:teuthology.orchestra.run.trial012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T21:19:56.402 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T21:19:56.579 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T21:19:56.592 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T21:19:56.592 DEBUG:teuthology.orchestra.run.trial012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T21:19:56.594 DEBUG:teuthology.orchestra.run.trial090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T21:19:56.607 INFO:teuthology.orchestra.run.trial012.stderr:bash: line 1: ntpq: command not found 2026-02-13T21:19:56.609 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-13T21:19:56.628 INFO:teuthology.orchestra.run.trial012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T21:19:56.628 INFO:teuthology.orchestra.run.trial012.stdout:=============================================================================== 2026-02-13T21:19:56.628 INFO:teuthology.orchestra.run.trial012.stdout:^+ 96-19-94-82.cpe.sparklig> 1 6 377 65 -66us[ -23us] +/- 33ms 2026-02-13T21:19:56.628 INFO:teuthology.orchestra.run.trial012.stdout:^+ ntp.maxhost.io 2 6 377 64 -613us[ -572us] +/- 55ms 2026-02-13T21:19:56.628 INFO:teuthology.orchestra.run.trial012.stdout:^+ hou1.us.ntp.li 2 6 377 63 +99us[ +141us] +/- 57ms 2026-02-13T21:19:56.628 INFO:teuthology.orchestra.run.trial012.stdout:^* kjsl-fmt2-net.fmt2.kjsl.> 2 6 377 0 +1041us[+1047us] +/- 35ms 2026-02-13T21:19:56.631 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T21:19:56.631 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-13T21:19:56.631 INFO:teuthology.orchestra.run.trial090.stdout:^* 209.205.228.50 2 6 377 63 -2222us[-2494us] +/- 31ms 2026-02-13T21:19:56.631 INFO:teuthology.orchestra.run.trial090.stdout:^+ lax1.us.ntp.li 2 6 377 64 -332us[ -604us] +/- 35ms 2026-02-13T21:19:56.631 INFO:teuthology.orchestra.run.trial090.stdout:^- time2.lshiy.com 2 6 377 63 -206us[ -478us] +/- 131ms 2026-02-13T21:19:56.631 INFO:teuthology.orchestra.run.trial090.stdout:^+ arm1.maxhost.io 2 6 377 65 +255us[ -17us] +/- 54ms 2026-02-13T21:19:56.631 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T21:19:56.643 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T21:19:56.643 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T21:19:56.657 DEBUG:teuthology.orchestra.run.trial012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T21:19:56.730 DEBUG:teuthology.orchestra.run.trial090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T21:19:56.790 DEBUG:teuthology.orchestra.run.trial012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T21:19:56.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T21:19:56.818 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T21:19:56.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T21:19:56.844 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T21:19:56.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T21:19:56.877 INFO:teuthology.task.internal:Duration was 493.871294 seconds 2026-02-13T21:19:56.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T21:19:56.895 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T21:19:56.895 DEBUG:teuthology.orchestra.run.trial012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T21:19:56.897 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T21:19:56.931 INFO:teuthology.orchestra.run.trial012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T21:19:56.934 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T21:19:57.153 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T21:19:57.153 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial012.front.sepia.ceph.com 2026-02-13T21:19:57.153 DEBUG:teuthology.orchestra.run.trial012:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T21:19:57.213 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial090.front.sepia.ceph.com 2026-02-13T21:19:57.213 DEBUG:teuthology.orchestra.run.trial090:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T21:19:57.233 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T21:19:57.233 DEBUG:teuthology.orchestra.run.trial012:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T21:19:57.254 DEBUG:teuthology.orchestra.run.trial090:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T21:19:57.447 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T21:19:57.447 DEBUG:teuthology.orchestra.run.trial012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T21:19:57.448 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T21:19:57.469 INFO:teuthology.orchestra.run.trial012.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T21:19:57.469 INFO:teuthology.orchestra.run.trial012.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T21:19:57.469 INFO:teuthology.orchestra.run.trial012.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T21:19:57.469 INFO:teuthology.orchestra.run.trial012.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T21:19:57.469 INFO:teuthology.orchestra.run.trial012.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T21:19:57.472 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T21:19:57.472 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T21:19:57.472 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T21:19:57.472 INFO:teuthology.orchestra.run.trial090.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T21:19:57.473 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T21:19:57.492 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T21:19:57.505 INFO:teuthology.orchestra.run.trial012.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T21:19:57.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T21:19:57.523 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T21:19:57.524 DEBUG:teuthology.orchestra.run.trial012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T21:19:57.571 DEBUG:teuthology.orchestra.run.trial090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T21:19:57.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T21:19:57.608 DEBUG:teuthology.orchestra.run.trial012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T21:19:57.613 DEBUG:teuthology.orchestra.run.trial090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T21:19:57.635 INFO:teuthology.orchestra.run.trial012.stdout:kernel.core_pattern = core 2026-02-13T21:19:57.659 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = core 2026-02-13T21:19:57.671 DEBUG:teuthology.orchestra.run.trial012:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T21:19:57.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T21:19:57.708 DEBUG:teuthology.orchestra.run.trial090:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T21:19:57.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T21:19:57.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T21:19:57.745 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T21:19:57.745 DEBUG:teuthology.misc:Transferring archived files from trial012:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085/remote/trial012 2026-02-13T21:19:57.745 DEBUG:teuthology.orchestra.run.trial012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T21:19:57.795 DEBUG:teuthology.misc:Transferring archived files from trial090:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50085/remote/trial090 2026-02-13T21:19:57.795 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T21:19:57.836 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T21:19:57.837 DEBUG:teuthology.orchestra.run.trial012:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T21:19:57.840 DEBUG:teuthology.orchestra.run.trial090:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T21:19:57.882 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T21:19:57.901 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T21:19:57.901 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T21:19:57.921 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T21:19:57.921 DEBUG:teuthology.orchestra.run.trial012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T21:19:57.923 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T21:19:57.938 INFO:teuthology.orchestra.run.trial012.stdout: 791883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 21:19 /home/ubuntu/cephtest 2026-02-13T21:19:57.942 INFO:teuthology.orchestra.run.trial090.stdout: 786856 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 21:19 /home/ubuntu/cephtest 2026-02-13T21:19:57.943 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T21:19:57.966 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T21:19:58.010 INFO:teuthology.run:Summary data: description: fs/cephadm/renamevolume/{0-start 1-rename conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} duration: 493.871294260025 flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com success: true 2026-02-13T21:19:58.011 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T21:19:58.140 INFO:teuthology.run:pass