2026-02-25T20:18:13.509 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T20:18:13.523 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T20:18:13.597 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70594 branch: wip-rocky10-branch-of-the-day-2026-02-24-1771941190 description: rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/s3/{auth-order/external-local s3tests} ubuntu_latest} email: aemerson@redhat.com first_in_suite: false flavor: default job_id: '70594' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rocky10-branch-of-the-day-2026-02-24-1771941190 ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw keystone accepted admin roles: admin rgw keystone accepted roles: admin,member rgw keystone admin domain: Default rgw keystone admin password: ADMIN rgw keystone admin project: admin rgw keystone admin user: admin rgw keystone api version: 3 rgw keystone implicit tenants: true rgw s3 auth order: sts, external, local rgw s3 auth use keystone: true rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw swift account in url: true rgw swift enforce content length: true rgw swift versioning enabled: true setgroup: ceph setuser: ceph global: osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 506b402a3d3a240d0bfe073b4769eaffdf84497b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} cephadm: distro-suffix: rockylinux-10 install: ceph: flavor: default sha1: 506b402a3d3a240d0bfe073b4769eaffdf84497b keystone: client.0: ec2 credentials: - project: s3tests user: s3tests-main projects: - description: s3tests project name: s3tests role-mappings: - name: member project: s3tests user: s3tests-main roles: - name: member users: - name: s3tests-main password: SECRET project: s3tests rgw: frontend: beast s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master workunit: branch: rocky101 sha1: 80c7315e5866ead938d7771844a338858c6ed0e3 owner: scheduled_aemerson@soko04.front.sepia.ceph.com priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6707 sha1: 506b402a3d3a240d0bfe073b4769eaffdf84497b sleep_before_teardown: 0 subset: 1/130000 suite: rgw suite_branch: rocky101 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 80c7315e5866ead938d7771844a338858c6ed0e3 targets: trial047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHWz1+X5Kfr0PPMNR7a4/ZT+QtVKC2I16MiPQe0OY/GcjztCrG0Vzc1gTqd32rI9pzwb1Ar1f7Qt3S7qQoIq9+I= tasks: - install: null - ceph: null - tox: - client.0 - keystone: client.0: force-branch: stable/2024.2 services: - description: Swift Service name: swift type: object-store - rgw: client.0: use-keystone-role: client.0 - s3tests: client.0: keystone users: s3 main: client: client.0 project: s3tests user: s3tests-main rgw_server: client.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-25_20:14:14 tube: trial user: aemerson verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-25T20:18:13.597 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa; will attempt to use it 2026-02-25T20:18:13.597 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks 2026-02-25T20:18:13.597 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-25T20:18:13.599 INFO:teuthology.task.internal:Checking packages... 2026-02-25T20:18:13.599 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '506b402a3d3a240d0bfe073b4769eaffdf84497b' 2026-02-25T20:18:13.599 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-25T20:18:13.599 INFO:teuthology.packaging:ref: None 2026-02-25T20:18:13.599 INFO:teuthology.packaging:tag: None 2026-02-25T20:18:13.599 INFO:teuthology.packaging:branch: wip-rocky10-branch-of-the-day-2026-02-24-1771941190 2026-02-25T20:18:13.599 INFO:teuthology.packaging:sha1: 506b402a3d3a240d0bfe073b4769eaffdf84497b 2026-02-25T20:18:13.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rocky10-branch-of-the-day-2026-02-24-1771941190 2026-02-25T20:18:13.717 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5580-g506b402a-1jammy 2026-02-25T20:18:13.718 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-25T20:18:13.730 INFO:teuthology.task.internal:no buildpackages task found 2026-02-25T20:18:13.730 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-25T20:18:13.742 INFO:teuthology.task.internal:Saving configuration 2026-02-25T20:18:13.754 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-25T20:18:13.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-25T20:18:13.844 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial047.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70594', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 20:14:37.486583', 'locked_by': 'scheduled_aemerson@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOddIFOxD9Crhybv5Lj5Z6SneXj9ziunY5jUF8JJSu1z'} 2026-02-25T20:18:13.844 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-25T20:18:13.855 INFO:teuthology.task.internal:roles: ubuntu@trial047.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-25T20:18:13.855 INFO:teuthology.run_tasks:Running task console_log... 2026-02-25T20:18:13.940 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x738180224680>, signals=[15]) 2026-02-25T20:18:13.941 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-25T20:18:13.952 INFO:teuthology.task.internal:Opening connections... 2026-02-25T20:18:13.952 DEBUG:teuthology.task.internal:connecting to ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:18:13.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T20:18:14.017 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-25T20:18:14.029 DEBUG:teuthology.orchestra.run.trial047:> uname -m 2026-02-25T20:18:14.096 INFO:teuthology.orchestra.run.trial047.stdout:x86_64 2026-02-25T20:18:14.096 DEBUG:teuthology.orchestra.run.trial047:> cat /etc/os-release 2026-02-25T20:18:14.140 INFO:teuthology.orchestra.run.trial047.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:NAME="Ubuntu" 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:VERSION_ID="22.04" 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:VERSION_CODENAME=jammy 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:ID=ubuntu 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:ID_LIKE=debian 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T20:18:14.141 INFO:teuthology.orchestra.run.trial047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T20:18:14.142 INFO:teuthology.orchestra.run.trial047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T20:18:14.142 INFO:teuthology.orchestra.run.trial047.stdout:UBUNTU_CODENAME=jammy 2026-02-25T20:18:14.143 INFO:teuthology.lock.ops:Updating trial047.front.sepia.ceph.com on lock server 2026-02-25T20:18:14.226 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-25T20:18:14.240 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-25T20:18:14.251 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-25T20:18:14.251 DEBUG:teuthology.orchestra.run.trial047:> test '!' -e /home/ubuntu/cephtest 2026-02-25T20:18:14.254 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-25T20:18:14.264 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-25T20:18:14.264 DEBUG:teuthology.orchestra.run.trial047:> test -z $(ls -A /var/lib/ceph) 2026-02-25T20:18:14.305 INFO:teuthology.orchestra.run.trial047.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-25T20:18:14.306 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-25T20:18:14.402 INFO:teuthology.run_tasks:Running task kernel... 2026-02-25T20:18:14.421 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-25T20:18:14.421 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-25T20:18:14.421 DEBUG:teuthology.orchestra.run.trial047:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T20:18:14.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T20:18:14.424 DEBUG:teuthology.orchestra.run.trial047:> uname -r 2026-02-25T20:18:14.468 INFO:teuthology.orchestra.run.trial047.stdout:5.15.0-170-generic 2026-02-25T20:18:14.469 INFO:teuthology.task.kernel:Running kernel on trial047: 5.15.0-170-generic 2026-02-25T20:18:14.469 DEBUG:teuthology.orchestra.run.trial047:> sudo apt-get clean 2026-02-25T20:18:14.526 DEBUG:teuthology.orchestra.run.trial047:> sudo apt-get update 2026-02-25T20:18:15.037 INFO:teuthology.orchestra.run.trial047.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-25T20:18:15.130 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-25T20:18:15.480 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-25T20:18:15.634 INFO:teuthology.orchestra.run.trial047.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-25T20:18:15.780 INFO:teuthology.orchestra.run.trial047.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3274 kB] 2026-02-25T20:18:16.196 INFO:teuthology.orchestra.run.trial047.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [498 kB] 2026-02-25T20:18:16.208 INFO:teuthology.orchestra.run.trial047.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.2 kB] 2026-02-25T20:18:16.209 INFO:teuthology.orchestra.run.trial047.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-25T20:18:16.245 INFO:teuthology.orchestra.run.trial047.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-25T20:18:16.252 INFO:teuthology.orchestra.run.trial047.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-25T20:18:16.253 INFO:teuthology.orchestra.run.trial047.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5400 kB] 2026-02-25T20:18:16.417 INFO:teuthology.orchestra.run.trial047.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1025 kB] 2026-02-25T20:18:16.441 INFO:teuthology.orchestra.run.trial047.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [3007 kB] 2026-02-25T20:18:16.531 INFO:teuthology.orchestra.run.trial047.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [430 kB] 2026-02-25T20:18:16.541 INFO:teuthology.orchestra.run.trial047.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-25T20:18:16.541 INFO:teuthology.orchestra.run.trial047.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1019 kB] 2026-02-25T20:18:16.578 INFO:teuthology.orchestra.run.trial047.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [225 kB] 2026-02-25T20:18:16.585 INFO:teuthology.orchestra.run.trial047.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-25T20:18:16.585 INFO:teuthology.orchestra.run.trial047.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5217 kB] 2026-02-25T20:18:16.741 INFO:teuthology.orchestra.run.trial047.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [993 kB] 2026-02-25T20:18:20.131 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 23.1 MB in 3s (7792 kB/s) 2026-02-25T20:18:20.656 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:18:20.670 DEBUG:teuthology.orchestra.run.trial047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-25T20:18:20.704 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:18:20.811 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:18:20.812 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:18:20.900 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:18:20.900 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout: sg3-utils-udev 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout:The following additional packages will be installed: 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout: linux-generic linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-generic linux-image-5.15.0-171-generic 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-171-generic linux-modules-extra-5.15.0-171-generic 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout:Suggested packages: 2026-02-25T20:18:20.901 INFO:teuthology.orchestra.run.trial047.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-25T20:18:20.914 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:18:20.914 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-25T20:18:20.914 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-171-generic linux-modules-5.15.0-171-generic 2026-02-25T20:18:20.914 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-171-generic 2026-02-25T20:18:20.914 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be upgraded: 2026-02-25T20:18:20.914 INFO:teuthology.orchestra.run.trial047.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-25T20:18:21.264 INFO:teuthology.orchestra.run.trial047.stdout:3 upgraded, 5 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:18:21.264 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 113 MB of archives. 2026-02-25T20:18:21.264 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-25T20:18:21.264 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-171-generic amd64 5.15.0-171.181 [22.7 MB] 2026-02-25T20:18:22.362 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-171-generic amd64 5.15.0-171.181 [11.6 MB] 2026-02-25T20:18:22.633 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-171-generic amd64 5.15.0-171.181 [63.9 MB] 2026-02-25T20:18:24.131 INFO:teuthology.orchestra.run.trial047.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.171.160 [1658 B] 2026-02-25T20:18:24.131 INFO:teuthology.orchestra.run.trial047.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.171.160 [2486 B] 2026-02-25T20:18:24.131 INFO:teuthology.orchestra.run.trial047.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171 all 5.15.0-171.181 [12.4 MB] 2026-02-25T20:18:24.410 INFO:teuthology.orchestra.run.trial047.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171-generic amd64 5.15.0-171.181 [2849 kB] 2026-02-25T20:18:24.477 INFO:teuthology.orchestra.run.trial047.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.171.160 [2332 B] 2026-02-25T20:18:24.676 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 113 MB in 4s (31.8 MB/s) 2026-02-25T20:18:24.696 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package linux-modules-5.15.0-171-generic. 2026-02-25T20:18:24.870 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-25T20:18:24.871 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../0-linux-modules-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-25T20:18:24.873 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:25.221 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package linux-image-5.15.0-171-generic. 2026-02-25T20:18:25.230 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../1-linux-image-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-25T20:18:25.252 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:25.292 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-171-generic. 2026-02-25T20:18:25.300 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-25T20:18:25.301 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:26.413 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../3-linux-generic_5.15.0.171.160_amd64.deb ... 2026-02-25T20:18:26.414 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking linux-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-25T20:18:26.438 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.171.160_amd64.deb ... 2026-02-25T20:18:26.439 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking linux-image-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-25T20:18:26.456 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package linux-headers-5.15.0-171. 2026-02-25T20:18:26.465 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../5-linux-headers-5.15.0-171_5.15.0-171.181_all.deb ... 2026-02-25T20:18:26.465 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-25T20:18:27.859 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package linux-headers-5.15.0-171-generic. 2026-02-25T20:18:27.873 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../6-linux-headers-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-25T20:18:27.874 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:28.456 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.171.160_amd64.deb ... 2026-02-25T20:18:28.457 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking linux-headers-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-25T20:18:28.483 INFO:teuthology.orchestra.run.trial047.stdout:Setting up linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-25T20:18:28.484 INFO:teuthology.orchestra.run.trial047.stdout:Setting up linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:28.486 INFO:teuthology.orchestra.run.trial047.stdout:Setting up linux-headers-generic (5.15.0.171.160) ... 2026-02-25T20:18:28.488 INFO:teuthology.orchestra.run.trial047.stdout:Setting up linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:29.265 INFO:teuthology.orchestra.run.trial047.stdout:I: /boot/vmlinuz.old is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-25T20:18:29.266 INFO:teuthology.orchestra.run.trial047.stdout:I: /boot/initrd.img.old is now a symlink to initrd.img-5.15.0-170-generic 2026-02-25T20:18:29.266 INFO:teuthology.orchestra.run.trial047.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-171-generic 2026-02-25T20:18:29.266 INFO:teuthology.orchestra.run.trial047.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-171-generic 2026-02-25T20:18:29.275 INFO:teuthology.orchestra.run.trial047.stdout:Setting up linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:30.073 INFO:teuthology.orchestra.run.trial047.stdout:Setting up linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:30.858 INFO:teuthology.orchestra.run.trial047.stdout:Setting up linux-image-generic (5.15.0.171.160) ... 2026-02-25T20:18:30.859 INFO:teuthology.orchestra.run.trial047.stdout:Setting up linux-generic (5.15.0.171.160) ... 2026-02-25T20:18:30.861 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-25T20:18:30.865 INFO:teuthology.orchestra.run.trial047.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-25T20:18:30.866 INFO:teuthology.orchestra.run.trial047.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-171-generic 2026-02-25T20:18:37.923 INFO:teuthology.orchestra.run.trial047.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-25T20:18:44.496 INFO:teuthology.orchestra.run.trial047.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-25T20:18:44.496 INFO:teuthology.orchestra.run.trial047.stdout:Sourcing file `/etc/default/grub' 2026-02-25T20:18:44.514 INFO:teuthology.orchestra.run.trial047.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-25T20:18:44.515 INFO:teuthology.orchestra.run.trial047.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-25T20:18:44.518 INFO:teuthology.orchestra.run.trial047.stdout:Generating grub configuration file ... 2026-02-25T20:18:44.599 INFO:teuthology.orchestra.run.trial047.stdout:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-25T20:18:44.607 INFO:teuthology.orchestra.run.trial047.stdout:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-25T20:18:44.782 INFO:teuthology.orchestra.run.trial047.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-25T20:18:44.788 INFO:teuthology.orchestra.run.trial047.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-25T20:18:44.830 INFO:teuthology.orchestra.run.trial047.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-25T20:18:44.835 INFO:teuthology.orchestra.run.trial047.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-25T20:18:44.908 INFO:teuthology.orchestra.run.trial047.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-25T20:18:44.909 INFO:teuthology.orchestra.run.trial047.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-25T20:18:44.909 INFO:teuthology.orchestra.run.trial047.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-25T20:18:44.911 INFO:teuthology.orchestra.run.trial047.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T20:18:44.921 INFO:teuthology.orchestra.run.trial047.stdout:done 2026-02-25T20:18:45.327 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.327 INFO:teuthology.orchestra.run.trial047.stdout:Pending kernel upgrade! 2026-02-25T20:18:45.328 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.328 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel version: 2026-02-25T20:18:45.328 INFO:teuthology.orchestra.run.trial047.stdout: 5.15.0-170-generic 2026-02-25T20:18:45.328 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.328 INFO:teuthology.orchestra.run.trial047.stdout:Diagnostics: 2026-02-25T20:18:45.328 INFO:teuthology.orchestra.run.trial047.stdout: The currently running kernel version is not the expected kernel version 5.15.0-171-generic. 2026-02-25T20:18:45.328 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.328 INFO:teuthology.orchestra.run.trial047.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:18:45.329 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:18:46.138 DEBUG:teuthology.orchestra.run.trial047:> dpkg -s linux-image-generic 2026-02-25T20:18:46.148 INFO:teuthology.orchestra.run.trial047.stdout:Package: linux-image-generic 2026-02-25T20:18:46.148 INFO:teuthology.orchestra.run.trial047.stdout:Status: install ok installed 2026-02-25T20:18:46.148 INFO:teuthology.orchestra.run.trial047.stdout:Priority: optional 2026-02-25T20:18:46.148 INFO:teuthology.orchestra.run.trial047.stdout:Section: kernel 2026-02-25T20:18:46.148 INFO:teuthology.orchestra.run.trial047.stdout:Installed-Size: 22 2026-02-25T20:18:46.148 INFO:teuthology.orchestra.run.trial047.stdout:Maintainer: Ubuntu Kernel Team 2026-02-25T20:18:46.148 INFO:teuthology.orchestra.run.trial047.stdout:Architecture: amd64 2026-02-25T20:18:46.149 INFO:teuthology.orchestra.run.trial047.stdout:Source: linux-meta 2026-02-25T20:18:46.149 INFO:teuthology.orchestra.run.trial047.stdout:Version: 5.15.0.171.160 2026-02-25T20:18:46.149 INFO:teuthology.orchestra.run.trial047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-25T20:18:46.149 INFO:teuthology.orchestra.run.trial047.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-25T20:18:46.149 INFO:teuthology.orchestra.run.trial047.stdout:Recommends: thermald 2026-02-25T20:18:46.149 INFO:teuthology.orchestra.run.trial047.stdout:Description: Generic Linux kernel image 2026-02-25T20:18:46.149 INFO:teuthology.orchestra.run.trial047.stdout: This package will always depend on the latest generic kernel image 2026-02-25T20:18:46.149 INFO:teuthology.orchestra.run.trial047.stdout: available. 2026-02-25T20:18:46.150 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-170-generic Expected: 5.15.0-171-generic 2026-02-25T20:18:46.151 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T20:18:46.151 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T20:18:46.151 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-25T20:18:46.151 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial047.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T20:18:46.151 DEBUG:teuthology.orchestra.run.trial047:> sudo apt-get clean 2026-02-25T20:18:46.232 DEBUG:teuthology.orchestra.run.trial047:> sudo apt-get update 2026-02-25T20:18:46.721 INFO:teuthology.orchestra.run.trial047.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-25T20:18:46.803 INFO:teuthology.orchestra.run.trial047.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-25T20:18:46.892 INFO:teuthology.orchestra.run.trial047.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-25T20:18:46.980 INFO:teuthology.orchestra.run.trial047.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-25T20:18:47.637 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:18:47.652 DEBUG:teuthology.orchestra.run.trial047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-25T20:18:47.685 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:18:47.794 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:18:47.794 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:18:47.881 INFO:teuthology.orchestra.run.trial047.stdout:linux-image-generic is already the newest version (5.15.0.171.160). 2026-02-25T20:18:47.881 INFO:teuthology.orchestra.run.trial047.stdout:linux-image-generic set to manually installed. 2026-02-25T20:18:47.881 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:18:47.881 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:18:47.881 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:18:47.881 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:18:47.882 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:18:47.882 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:18:47.882 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:18:47.901 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:18:47.903 DEBUG:teuthology.orchestra.run.trial047:> dpkg -s linux-image-generic 2026-02-25T20:18:47.953 INFO:teuthology.orchestra.run.trial047.stdout:Package: linux-image-generic 2026-02-25T20:18:47.953 INFO:teuthology.orchestra.run.trial047.stdout:Status: install ok installed 2026-02-25T20:18:47.953 INFO:teuthology.orchestra.run.trial047.stdout:Priority: optional 2026-02-25T20:18:47.953 INFO:teuthology.orchestra.run.trial047.stdout:Section: kernel 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Installed-Size: 22 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Maintainer: Ubuntu Kernel Team 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Architecture: amd64 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Source: linux-meta 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Version: 5.15.0.171.160 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Recommends: thermald 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout:Description: Generic Linux kernel image 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout: This package will always depend on the latest generic kernel image 2026-02-25T20:18:47.954 INFO:teuthology.orchestra.run.trial047.stdout: available. 2026-02-25T20:18:47.955 DEBUG:teuthology.orchestra.run.trial047:> mktemp 2026-02-25T20:18:48.004 INFO:teuthology.orchestra.run.trial047.stdout:/tmp/tmp.8imU7gz3dn 2026-02-25T20:18:48.005 DEBUG:teuthology.orchestra.run.trial047:> sudo cp /boot/grub/grub.cfg /tmp/tmp.8imU7gz3dn 2026-02-25T20:18:48.057 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod 0666 /tmp/tmp.8imU7gz3dn 2026-02-25T20:18:48.154 DEBUG:teuthology.orchestra.remote:trial047:/tmp/tmp.8imU7gz3dn is 9KB 2026-02-25T20:18:48.163 DEBUG:teuthology.orchestra.run.trial047:> rm -fr /tmp/tmp.8imU7gz3dn 2026-02-25T20:18:48.167 DEBUG:teuthology.orchestra.run.trial047:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-25T20:18:48.220 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:18:48.220 DEBUG:teuthology.orchestra.run.trial047:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-25T20:18:48.220 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-25T20:18:48.274 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-171-generic 2026-02-25T20:18:48.274 DEBUG:teuthology.orchestra.run.trial047:> sudo update-grub 2026-02-25T20:18:48.509 INFO:teuthology.orchestra.run.trial047.stderr:Sourcing file `/etc/default/grub' 2026-02-25T20:18:48.529 INFO:teuthology.orchestra.run.trial047.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-25T20:18:48.530 INFO:teuthology.orchestra.run.trial047.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-25T20:18:48.532 INFO:teuthology.orchestra.run.trial047.stderr:Generating grub configuration file ... 2026-02-25T20:18:48.616 INFO:teuthology.orchestra.run.trial047.stderr:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-25T20:18:48.621 INFO:teuthology.orchestra.run.trial047.stderr:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-25T20:18:48.795 INFO:teuthology.orchestra.run.trial047.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-25T20:18:48.800 INFO:teuthology.orchestra.run.trial047.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-25T20:18:48.843 INFO:teuthology.orchestra.run.trial047.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-25T20:18:48.848 INFO:teuthology.orchestra.run.trial047.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-25T20:18:48.922 INFO:teuthology.orchestra.run.trial047.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-25T20:18:48.922 INFO:teuthology.orchestra.run.trial047.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-25T20:18:48.922 INFO:teuthology.orchestra.run.trial047.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-25T20:18:48.925 INFO:teuthology.orchestra.run.trial047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T20:18:48.932 INFO:teuthology.orchestra.run.trial047.stderr:done 2026-02-25T20:18:48.933 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial047 2026-02-25T20:18:48.934 DEBUG:teuthology.orchestra.run.trial047:> sudo bash -c ' 2026-02-25T20:18:48.934 DEBUG:teuthology.orchestra.run.trial047:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T20:18:48.934 DEBUG:teuthology.orchestra.run.trial047:> ' 2026-02-25T20:19:18.936 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-25T20:19:18.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial047.front.sepia.ceph.com' 2026-02-25T20:19:18.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T20:19:33.249 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.47 2026-02-25T20:19:42.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial047.front.sepia.ceph.com' 2026-02-25T20:19:42.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T20:20:42.321 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T20:20:54.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial047.front.sepia.ceph.com' 2026-02-25T20:20:54.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T20:20:54.458 DEBUG:teuthology.orchestra.run.trial047:> true 2026-02-25T20:20:54.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial047.front.sepia.ceph.com' 2026-02-25T20:20:54.844 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-171-generic"... 2026-02-25T20:20:54.844 DEBUG:teuthology.orchestra.run.trial047:> uname -r 2026-02-25T20:20:54.890 INFO:teuthology.orchestra.run.trial047.stdout:5.15.0-171-generic 2026-02-25T20:20:54.890 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-171-generic vs 5.15.0-171-generic 2026-02-25T20:20:54.890 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T20:20:54.890 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-25T20:20:55.891 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-25T20:20:55.892 DEBUG:teuthology.orchestra.run.trial047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T20:20:55.904 INFO:teuthology.orchestra.run.trial047.stdout:ttyS1 2026-02-25T20:20:55.924 DEBUG:teuthology.parallel:result is None 2026-02-25T20:20:55.924 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-25T20:20:55.936 INFO:teuthology.task.internal:Creating test directory... 2026-02-25T20:20:55.936 DEBUG:teuthology.orchestra.run.trial047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T20:20:55.970 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-25T20:20:55.982 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-25T20:20:55.997 INFO:teuthology.task.internal:Creating archive directory... 2026-02-25T20:20:55.997 DEBUG:teuthology.orchestra.run.trial047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T20:20:56.020 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-25T20:20:56.031 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-25T20:20:56.031 DEBUG:teuthology.orchestra.run.trial047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T20:20:56.064 INFO:teuthology.orchestra.run.trial047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T20:20:56.070 INFO:teuthology.orchestra.run.trial047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T20:20:56.071 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-25T20:20:56.083 INFO:teuthology.task.internal:Configuring sudo... 2026-02-25T20:20:56.084 DEBUG:teuthology.orchestra.run.trial047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T20:20:56.123 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-25T20:20:56.141 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-25T20:20:56.141 DEBUG:teuthology.orchestra.run.trial047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T20:20:56.170 DEBUG:teuthology.orchestra.run.trial047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T20:20:56.214 DEBUG:teuthology.orchestra.run.trial047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T20:20:56.258 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:20:56.258 DEBUG:teuthology.orchestra.run.trial047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T20:20:56.306 DEBUG:teuthology.orchestra.run.trial047:> sudo service rsyslog restart 2026-02-25T20:20:56.364 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-25T20:20:56.376 INFO:teuthology.task.internal:Starting timer... 2026-02-25T20:20:56.376 INFO:teuthology.run_tasks:Running task pcp... 2026-02-25T20:20:56.395 INFO:teuthology.run_tasks:Running task selinux... 2026-02-25T20:20:56.407 DEBUG:teuthology.task.selinux:Excluding trial047: OS 'ubuntu' does not support SELinux 2026-02-25T20:20:56.407 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-25T20:20:56.407 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-25T20:20:56.407 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-25T20:20:56.407 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-25T20:20:56.420 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-25T20:20:56.430 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-25T20:20:56.431 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial047.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-25T20:23:04.740 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial047.front.sepia.ceph.com')] 2026-02-25T20:23:04.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial047.front.sepia.ceph.com' 2026-02-25T20:23:04.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T20:23:04.819 DEBUG:teuthology.orchestra.run.trial047:> true 2026-02-25T20:23:05.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial047.front.sepia.ceph.com' 2026-02-25T20:23:05.064 INFO:teuthology.run_tasks:Running task clock... 2026-02-25T20:23:05.076 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-25T20:23:05.077 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T20:23:05.077 DEBUG:teuthology.orchestra.run.trial047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Command line: ntpd -gq 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: ---------------------------------------------------- 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: ntp-4 is maintained by Network Time Foundation, 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: corporation. Support and training for ntp-4 are 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: available at https://www.nwtime.org/support 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: ---------------------------------------------------- 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: proto: precision = 0.020 usec (-25) 2026-02-25T20:23:05.129 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: basedate set to 2022-02-04 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: gps base set to 2022-02-06 (week 2196) 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: restrict ::: KOD does nothing without LIMITED. 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Listen and drop on 0 v6wildcard [::]:123 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Listen normally on 2 lo 127.0.0.1:123 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Listen normally on 3 enp1s0f0 10.20.193.47:123 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Listen normally on 4 lo [::1]:123 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5f94%2]:123 2026-02-25T20:23:05.130 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:05 ntpd[8810]: Listening on routing socket on fd #22 for interface updates 2026-02-25T20:23:06.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:06.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:06.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:06.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:06.203 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:06.203 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:06.203 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:06.203 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:06.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:06.212 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:06.212 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:06.212 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:06 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:08.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:08.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:08.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:08.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:08.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:08.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:08.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:08.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:08.148 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:08.149 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:08.149 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:08.149 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:08.156 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:08.156 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:08.157 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:08.157 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:08.202 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:08.202 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:08.202 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:08.203 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:08.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:08.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:08.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:08.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:08 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:10.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:10.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:10.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:10.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:10.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:10.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:10.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:10.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:10.149 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:10.149 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:10.149 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:10.149 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:10.156 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:10.157 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:10.157 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:10.157 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:10.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:10.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:10.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:10.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:10.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:10.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:10.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:10.211 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:10 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:12.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:12.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:12.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:12.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:12.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:12.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:12.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:12.129 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:12.148 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:12.148 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:12.148 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:12.148 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:12.156 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:12.156 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:12.156 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:12.156 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:12.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-25T20:23:12.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/rawstats.20260225: Permission denied 2026-02-25T20:23:12.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-25T20:23:12.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/peerstats.20260225: Permission denied 2026-02-25T20:23:12.199 INFO:teuthology.orchestra.run.trial047.stdout:25 Feb 20:23:12 ntpd[8810]: ntpd: time set -0.415592 s 2026-02-25T20:23:12.199 INFO:teuthology.orchestra.run.trial047.stdout:ntpd: time set -0.415592s 2026-02-25T20:23:12.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-25T20:23:12.199 INFO:teuthology.orchestra.run.trial047.stderr:25 Feb 20:23:12 ntpd[8810]: can't open /var/log/ntpstats/loopstats.20260225: Permission denied 2026-02-25T20:23:12.248 INFO:teuthology.orchestra.run.trial047.stdout: remote refid st t when poll reach delay offset jitter 2026-02-25T20:23:12.249 INFO:teuthology.orchestra.run.trial047.stdout:============================================================================== 2026-02-25T20:23:12.249 INFO:teuthology.orchestra.run.trial047.stdout: 172-238-164-57. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-25T20:23:12.249 INFO:teuthology.orchestra.run.trial047.stdout: 23.186.168.130 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-25T20:23:12.249 INFO:teuthology.orchestra.run.trial047.stdout: t2.time.bf1.yah .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-25T20:23:12.249 INFO:teuthology.orchestra.run.trial047.stdout: 170-187-147-56. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-25T20:23:12.250 INFO:teuthology.run_tasks:Running task install... 2026-02-25T20:23:12.261 DEBUG:teuthology.task.install:project ceph 2026-02-25T20:23:12.262 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '506b402a3d3a240d0bfe073b4769eaffdf84497b'}} 2026-02-25T20:23:12.262 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '506b402a3d3a240d0bfe073b4769eaffdf84497b'} 2026-02-25T20:23:12.262 INFO:teuthology.task.install:Using flavor: default 2026-02-25T20:23:12.265 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-25T20:23:12.265 INFO:teuthology.task.install:extra packages: [] 2026-02-25T20:23:12.265 DEBUG:teuthology.orchestra.run.trial047:> sudo apt-key list | grep Ceph 2026-02-25T20:23:12.343 INFO:teuthology.orchestra.run.trial047.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-25T20:23:12.372 INFO:teuthology.orchestra.run.trial047.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-25T20:23:12.372 INFO:teuthology.orchestra.run.trial047.stdout:uid [ unknown] Ceph.com (release key) 2026-02-25T20:23:12.372 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-25T20:23:12.373 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=506b402a3d3a240d0bfe073b4769eaffdf84497b 2026-02-25T20:23:12.499 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default/ 2026-02-25T20:23:12.499 INFO:teuthology.task.install.deb:Package version is 20.3.0-5580-g506b402a-1jammy 2026-02-25T20:23:12.845 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:23:12.845 DEBUG:teuthology.orchestra.run.trial047:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-25T20:23:12.855 DEBUG:teuthology.orchestra.run.trial047:> sudo apt-get update 2026-02-25T20:23:13.224 INFO:teuthology.orchestra.run.trial047.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy InRelease 2026-02-25T20:23:13.292 INFO:teuthology.orchestra.run.trial047.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-25T20:23:13.292 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-25T20:23:13.358 INFO:teuthology.orchestra.run.trial047.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-25T20:23:13.362 INFO:teuthology.orchestra.run.trial047.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-25T20:23:13.430 INFO:teuthology.orchestra.run.trial047.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-25T20:23:13.432 INFO:teuthology.orchestra.run.trial047.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-25T20:23:13.507 INFO:teuthology.orchestra.run.trial047.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-25T20:23:13.653 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 26.9 kB in 1s (42.3 kB/s) 2026-02-25T20:23:14.169 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:23:14.181 DEBUG:teuthology.orchestra.run.trial047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5580-g506b402a-1jammy cephadm=20.3.0-5580-g506b402a-1jammy ceph-mds=20.3.0-5580-g506b402a-1jammy ceph-mgr=20.3.0-5580-g506b402a-1jammy ceph-osd=20.3.0-5580-g506b402a-1jammy ceph-osd-classic=20.3.0-5580-g506b402a-1jammy ceph-common=20.3.0-5580-g506b402a-1jammy ceph-fuse=20.3.0-5580-g506b402a-1jammy ceph-test=20.3.0-5580-g506b402a-1jammy ceph-volume=20.3.0-5580-g506b402a-1jammy radosgw=20.3.0-5580-g506b402a-1jammy python3-rados=20.3.0-5580-g506b402a-1jammy python3-rgw=20.3.0-5580-g506b402a-1jammy python3-cephfs=20.3.0-5580-g506b402a-1jammy python3-rbd=20.3.0-5580-g506b402a-1jammy libcephfs2=20.3.0-5580-g506b402a-1jammy libcephfs-dev=20.3.0-5580-g506b402a-1jammy librados2=20.3.0-5580-g506b402a-1jammy librbd1=20.3.0-5580-g506b402a-1jammy rbd-fuse=20.3.0-5580-g506b402a-1jammy 2026-02-25T20:23:14.214 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:23:14.326 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:23:14.327 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout:The following additional packages will be installed: 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-25T20:23:14.416 INFO:teuthology.orchestra.run.trial047.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout:Suggested packages: 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout:Recommended packages: 2026-02-25T20:23:14.417 INFO:teuthology.orchestra.run.trial047.stdout: btrfs-tools 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-25T20:23:14.450 INFO:teuthology.orchestra.run.trial047.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-25T20:23:14.451 INFO:teuthology.orchestra.run.trial047.stdout: socat xmlstarlet 2026-02-25T20:23:14.806 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 87 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:23:14.807 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 693 MB of archives. 2026-02-25T20:23:14.807 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 2583 MB of additional disk space will be used. 2026-02-25T20:23:14.807 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5580-g506b402a-1jammy [3794 kB] 2026-02-25T20:23:14.870 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-25T20:23:15.284 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-25T20:23:15.297 INFO:teuthology.orchestra.run.trial047.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-25T20:23:15.381 INFO:teuthology.orchestra.run.trial047.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-25T20:23:15.626 INFO:teuthology.orchestra.run.trial047.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-25T20:23:15.639 INFO:teuthology.orchestra.run.trial047.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-25T20:23:15.672 INFO:teuthology.orchestra.run.trial047.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-25T20:23:15.682 INFO:teuthology.orchestra.run.trial047.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-25T20:23:15.684 INFO:teuthology.orchestra.run.trial047.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-25T20:23:15.685 INFO:teuthology.orchestra.run.trial047.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-25T20:23:15.686 INFO:teuthology.orchestra.run.trial047.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-25T20:23:15.706 INFO:teuthology.orchestra.run.trial047.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-25T20:23:15.707 INFO:teuthology.orchestra.run.trial047.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-25T20:23:15.715 INFO:teuthology.orchestra.run.trial047.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-25T20:23:15.796 INFO:teuthology.orchestra.run.trial047.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-25T20:23:15.796 INFO:teuthology.orchestra.run.trial047.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-25T20:23:15.796 INFO:teuthology.orchestra.run.trial047.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-25T20:23:15.797 INFO:teuthology.orchestra.run.trial047.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-25T20:23:15.797 INFO:teuthology.orchestra.run.trial047.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-25T20:23:15.797 INFO:teuthology.orchestra.run.trial047.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-25T20:23:15.797 INFO:teuthology.orchestra.run.trial047.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-25T20:23:15.803 INFO:teuthology.orchestra.run.trial047.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-25T20:23:15.803 INFO:teuthology.orchestra.run.trial047.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-25T20:23:15.888 INFO:teuthology.orchestra.run.trial047.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-25T20:23:15.891 INFO:teuthology.orchestra.run.trial047.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-25T20:23:15.891 INFO:teuthology.orchestra.run.trial047.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-25T20:23:15.892 INFO:teuthology.orchestra.run.trial047.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-25T20:23:15.922 INFO:teuthology.orchestra.run.trial047.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-25T20:23:15.925 INFO:teuthology.orchestra.run.trial047.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-25T20:23:15.925 INFO:teuthology.orchestra.run.trial047.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-25T20:23:15.995 INFO:teuthology.orchestra.run.trial047.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-25T20:23:15.995 INFO:teuthology.orchestra.run.trial047.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-25T20:23:15.996 INFO:teuthology.orchestra.run.trial047.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-25T20:23:15.996 INFO:teuthology.orchestra.run.trial047.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-25T20:23:15.996 INFO:teuthology.orchestra.run.trial047.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-25T20:23:15.997 INFO:teuthology.orchestra.run.trial047.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-25T20:23:16.068 INFO:teuthology.orchestra.run.trial047.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-25T20:23:16.070 INFO:teuthology.orchestra.run.trial047.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-25T20:23:16.071 INFO:teuthology.orchestra.run.trial047.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-25T20:23:16.156 INFO:teuthology.orchestra.run.trial047.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-25T20:23:16.159 INFO:teuthology.orchestra.run.trial047.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-25T20:23:16.162 INFO:teuthology.orchestra.run.trial047.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-25T20:23:16.166 INFO:teuthology.orchestra.run.trial047.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-25T20:23:16.169 INFO:teuthology.orchestra.run.trial047.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-25T20:23:16.169 INFO:teuthology.orchestra.run.trial047.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-25T20:23:16.170 INFO:teuthology.orchestra.run.trial047.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-25T20:23:16.244 INFO:teuthology.orchestra.run.trial047.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-25T20:23:16.244 INFO:teuthology.orchestra.run.trial047.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-25T20:23:16.252 INFO:teuthology.orchestra.run.trial047.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-25T20:23:16.268 INFO:teuthology.orchestra.run.trial047.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5580-g506b402a-1jammy [2912 kB] 2026-02-25T20:23:16.332 INFO:teuthology.orchestra.run.trial047.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-25T20:23:16.334 INFO:teuthology.orchestra.run.trial047.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-25T20:23:16.334 INFO:teuthology.orchestra.run.trial047.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-25T20:23:16.335 INFO:teuthology.orchestra.run.trial047.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-25T20:23:17.155 INFO:teuthology.orchestra.run.trial047.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5580-g506b402a-1jammy [882 kB] 2026-02-25T20:23:17.474 INFO:teuthology.orchestra.run.trial047.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5580-g506b402a-1jammy [359 kB] 2026-02-25T20:23:17.551 INFO:teuthology.orchestra.run.trial047.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5580-g506b402a-1jammy [32.8 kB] 2026-02-25T20:23:17.611 INFO:teuthology.orchestra.run.trial047.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5580-g506b402a-1jammy [225 kB] 2026-02-25T20:23:17.681 INFO:teuthology.orchestra.run.trial047.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5580-g506b402a-1jammy [89.0 kB] 2026-02-25T20:23:17.686 INFO:teuthology.orchestra.run.trial047.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5580-g506b402a-1jammy [339 kB] 2026-02-25T20:23:17.820 INFO:teuthology.orchestra.run.trial047.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5580-g506b402a-1jammy [9132 kB] 2026-02-25T20:23:20.686 INFO:teuthology.orchestra.run.trial047.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5580-g506b402a-1jammy [112 kB] 2026-02-25T20:23:20.751 INFO:teuthology.orchestra.run.trial047.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5580-g506b402a-1jammy [261 kB] 2026-02-25T20:23:20.822 INFO:teuthology.orchestra.run.trial047.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5580-g506b402a-1jammy [31.6 MB] 2026-02-25T20:23:28.254 INFO:teuthology.orchestra.run.trial047.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5580-g506b402a-1jammy [4984 kB] 2026-02-25T20:23:29.848 INFO:teuthology.orchestra.run.trial047.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5580-g506b402a-1jammy [297 kB] 2026-02-25T20:23:29.960 INFO:teuthology.orchestra.run.trial047.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5580-g506b402a-1jammy [127 kB] 2026-02-25T20:23:29.995 INFO:teuthology.orchestra.run.trial047.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5580-g506b402a-1jammy [939 kB] 2026-02-25T20:23:30.321 INFO:teuthology.orchestra.run.trial047.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5580-g506b402a-1jammy [7540 kB] 2026-02-25T20:23:32.867 INFO:teuthology.orchestra.run.trial047.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5580-g506b402a-1jammy [468 MB] 2026-02-25T20:27:17.898 INFO:teuthology.orchestra.run.trial047.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5580-g506b402a-1jammy [180 kB] 2026-02-25T20:27:17.899 INFO:teuthology.orchestra.run.trial047.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5580-g506b402a-1jammy [14.0 kB] 2026-02-25T20:27:17.899 INFO:teuthology.orchestra.run.trial047.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5580-g506b402a-1jammy [1030 kB] 2026-02-25T20:27:18.030 INFO:teuthology.orchestra.run.trial047.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5580-g506b402a-1jammy [2437 kB] 2026-02-25T20:27:18.327 INFO:teuthology.orchestra.run.trial047.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5580-g506b402a-1jammy [1072 kB] 2026-02-25T20:27:18.451 INFO:teuthology.orchestra.run.trial047.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5580-g506b402a-1jammy [191 kB] 2026-02-25T20:27:18.482 INFO:teuthology.orchestra.run.trial047.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5580-g506b402a-1jammy [49.3 MB] 2026-02-25T20:27:25.646 INFO:teuthology.orchestra.run.trial047.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5580-g506b402a-1jammy [8626 kB] 2026-02-25T20:27:27.119 INFO:teuthology.orchestra.run.trial047.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5580-g506b402a-1jammy [14.2 kB] 2026-02-25T20:27:27.119 INFO:teuthology.orchestra.run.trial047.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5580-g506b402a-1jammy [65.6 MB] 2026-02-25T20:27:38.287 INFO:teuthology.orchestra.run.trial047.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5580-g506b402a-1jammy [136 kB] 2026-02-25T20:27:38.288 INFO:teuthology.orchestra.run.trial047.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5580-g506b402a-1jammy [47.3 kB] 2026-02-25T20:27:38.288 INFO:teuthology.orchestra.run.trial047.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5580-g506b402a-1jammy [33.1 kB] 2026-02-25T20:27:38.305 INFO:teuthology.orchestra.run.trial047.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5580-g506b402a-1jammy [44.2 kB] 2026-02-25T20:27:38.306 INFO:teuthology.orchestra.run.trial047.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5580-g506b402a-1jammy [18.4 MB] 2026-02-25T20:27:41.388 INFO:teuthology.orchestra.run.trial047.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-24-1771941190/506b402a3d3a240d0bfe073b4769eaffdf84497b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5580-g506b402a-1jammy [93.7 kB] 2026-02-25T20:27:41.667 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 693 MB in 4min 27s (2598 kB/s) 2026-02-25T20:27:41.684 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-25T20:27:41.852 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 202926 files and directories currently installed.) 2026-02-25T20:27:41.855 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-25T20:27:41.856 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-25T20:27:41.877 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-25T20:27:41.892 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-25T20:27:41.892 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-25T20:27:41.910 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-25T20:27:41.924 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-25T20:27:41.924 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-25T20:27:41.944 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-25T20:27:41.954 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-25T20:27:41.958 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-25T20:27:41.990 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-25T20:27:41.999 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-25T20:27:42.000 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-25T20:27:42.017 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-25T20:27:42.026 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-25T20:27:42.027 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-25T20:27:42.047 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-25T20:27:42.057 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-25T20:27:42.057 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-25T20:27:42.075 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package librados2. 2026-02-25T20:27:42.085 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../07-librados2_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.085 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking librados2 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.130 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libnbd0. 2026-02-25T20:27:42.141 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-25T20:27:42.141 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-25T20:27:42.156 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package librbd1. 2026-02-25T20:27:42.166 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../09-librbd1_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.166 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking librbd1 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.205 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libcephfs2. 2026-02-25T20:27:42.215 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.215 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libcephfs2 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.236 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-rados. 2026-02-25T20:27:42.246 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.246 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-rados (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.264 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-25T20:27:42.274 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5580-g506b402a-1jammy_all.deb ... 2026-02-25T20:27:42.274 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-ceph-argparse (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.289 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-cephfs. 2026-02-25T20:27:42.299 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.299 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-cephfs (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.316 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-25T20:27:42.326 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5580-g506b402a-1jammy_all.deb ... 2026-02-25T20:27:42.326 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-ceph-common (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.345 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-25T20:27:42.355 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-25T20:27:42.355 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-25T20:27:42.372 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-prettytable. 2026-02-25T20:27:42.382 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-25T20:27:42.382 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-25T20:27:42.397 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-rbd. 2026-02-25T20:27:42.406 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.407 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-rbd (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.425 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-25T20:27:42.434 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-25T20:27:42.435 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-25T20:27:42.453 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package librgw2. 2026-02-25T20:27:42.463 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../19-librgw2_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.463 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking librgw2 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.565 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-rgw. 2026-02-25T20:27:42.575 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.575 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-rgw (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.590 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-25T20:27:42.600 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-25T20:27:42.600 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-25T20:27:42.615 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libradosstriper1. 2026-02-25T20:27:42.625 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.626 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libradosstriper1 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.643 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-common. 2026-02-25T20:27:42.652 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.653 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-common (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:42.940 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-base. 2026-02-25T20:27:42.951 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:42.956 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-base (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:43.020 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-25T20:27:43.030 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-25T20:27:43.031 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-25T20:27:43.046 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-cheroot. 2026-02-25T20:27:43.056 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-25T20:27:43.056 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-25T20:27:43.073 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-25T20:27:43.083 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-25T20:27:43.084 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-25T20:27:43.099 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-25T20:27:43.109 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-25T20:27:43.109 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-25T20:27:43.124 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-25T20:27:43.134 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-25T20:27:43.134 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-25T20:27:43.149 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-tempora. 2026-02-25T20:27:43.159 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-25T20:27:43.160 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-25T20:27:43.175 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-portend. 2026-02-25T20:27:43.185 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-25T20:27:43.185 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-25T20:27:43.200 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-25T20:27:43.210 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-25T20:27:43.210 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-25T20:27:43.225 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-25T20:27:43.235 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-25T20:27:43.235 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-25T20:27:43.259 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-natsort. 2026-02-25T20:27:43.268 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-25T20:27:43.269 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-25T20:27:43.285 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-25T20:27:43.295 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5580-g506b402a-1jammy_all.deb ... 2026-02-25T20:27:43.295 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:43.326 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-25T20:27:43.335 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:43.336 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:43.351 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-mgr. 2026-02-25T20:27:43.361 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:43.361 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-mgr (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:43.383 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-mon. 2026-02-25T20:27:43.392 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:43.393 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-mon (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:43.457 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-25T20:27:43.467 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-25T20:27:43.468 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-25T20:27:43.484 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-25T20:27:43.494 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:43.494 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-osd-classic (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:47.456 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-osd. 2026-02-25T20:27:47.471 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:47.471 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-osd (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:47.491 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph. 2026-02-25T20:27:47.505 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../42-ceph_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:47.506 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:47.522 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-fuse. 2026-02-25T20:27:47.537 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:47.537 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-fuse (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:47.563 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-mds. 2026-02-25T20:27:47.576 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:47.576 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-mds (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:47.608 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package cephadm. 2026-02-25T20:27:47.618 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../45-cephadm_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:47.618 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking cephadm (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:47.635 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-25T20:27:47.645 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-25T20:27:47.645 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-25T20:27:47.667 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-25T20:27:47.677 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5580-g506b402a-1jammy_all.deb ... 2026-02-25T20:27:47.677 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:47.698 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-25T20:27:47.708 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-25T20:27:47.709 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-25T20:27:47.724 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-routes. 2026-02-25T20:27:47.734 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-25T20:27:47.734 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-25T20:27:47.755 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-25T20:27:47.765 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5580-g506b402a-1jammy_all.deb ... 2026-02-25T20:27:47.765 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:48.319 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-25T20:27:48.330 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-25T20:27:48.331 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-25T20:27:48.370 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-joblib. 2026-02-25T20:27:48.381 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-25T20:27:48.382 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-25T20:27:48.411 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-25T20:27:48.421 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-25T20:27:48.421 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-25T20:27:48.437 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-sklearn. 2026-02-25T20:27:48.448 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-25T20:27:48.449 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-25T20:27:48.532 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-25T20:27:48.542 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5580-g506b402a-1jammy_all.deb ... 2026-02-25T20:27:48.543 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:48.704 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-cachetools. 2026-02-25T20:27:48.715 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-25T20:27:48.715 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-25T20:27:48.731 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-rsa. 2026-02-25T20:27:48.741 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-25T20:27:48.741 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-25T20:27:48.760 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-google-auth. 2026-02-25T20:27:48.771 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-25T20:27:48.771 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-25T20:27:48.789 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-25T20:27:48.800 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-25T20:27:48.800 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-25T20:27:48.817 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-websocket. 2026-02-25T20:27:48.827 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-25T20:27:48.828 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-25T20:27:48.846 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-25T20:27:48.856 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-25T20:27:48.857 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-25T20:27:48.950 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-25T20:27:48.961 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5580-g506b402a-1jammy_all.deb ... 2026-02-25T20:27:48.961 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:48.976 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-25T20:27:48.987 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-25T20:27:48.987 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-25T20:27:49.004 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-25T20:27:49.014 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-25T20:27:49.014 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-25T20:27:49.030 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package jq. 2026-02-25T20:27:49.041 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-25T20:27:49.041 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-25T20:27:49.056 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package socat. 2026-02-25T20:27:49.066 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-25T20:27:49.066 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-25T20:27:49.086 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package xmlstarlet. 2026-02-25T20:27:49.097 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-25T20:27:49.097 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-25T20:27:49.133 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-test. 2026-02-25T20:27:49.144 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:49.144 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-test (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:49.762 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package ceph-volume. 2026-02-25T20:27:49.773 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5580-g506b402a-1jammy_all.deb ... 2026-02-25T20:27:49.773 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking ceph-volume (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:49.797 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-25T20:27:49.808 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:49.808 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libcephfs-daemon (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:49.823 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-25T20:27:49.833 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:49.834 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libcephfs-proxy2 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:49.849 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-25T20:27:49.860 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:49.860 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libcephfs-dev (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:49.876 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package nvme-cli. 2026-02-25T20:27:49.886 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-25T20:27:49.887 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-25T20:27:49.919 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-25T20:27:49.930 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-25T20:27:49.930 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-25T20:27:49.960 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-25T20:27:49.970 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-25T20:27:49.971 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-25T20:27:49.986 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-pluggy. 2026-02-25T20:27:49.997 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-25T20:27:49.997 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-25T20:27:50.014 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-psutil. 2026-02-25T20:27:50.024 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-25T20:27:50.025 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-25T20:27:50.044 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-py. 2026-02-25T20:27:50.054 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-25T20:27:50.055 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-25T20:27:50.076 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-pygments. 2026-02-25T20:27:50.087 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-25T20:27:50.087 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-25T20:27:50.129 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-toml. 2026-02-25T20:27:50.140 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-25T20:27:50.140 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-25T20:27:50.156 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-pytest. 2026-02-25T20:27:50.166 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-25T20:27:50.166 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-25T20:27:50.189 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-simplejson. 2026-02-25T20:27:50.199 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-25T20:27:50.200 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-25T20:27:50.225 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package python3-webob. 2026-02-25T20:27:50.235 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-25T20:27:50.235 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-25T20:27:50.252 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-25T20:27:50.263 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-25T20:27:50.263 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-25T20:27:50.331 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package radosgw. 2026-02-25T20:27:50.342 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../85-radosgw_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:50.342 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking radosgw (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:50.498 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package rbd-fuse. 2026-02-25T20:27:50.509 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5580-g506b402a-1jammy_amd64.deb ... 2026-02-25T20:27:50.510 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking rbd-fuse (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:50.537 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-25T20:27:50.602 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-25T20:27:50.603 INFO:teuthology.orchestra.run.trial047.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-25T20:27:50.673 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-25T20:27:50.937 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-25T20:27:51.286 INFO:teuthology.orchestra.run.trial047.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-25T20:27:51.297 INFO:teuthology.orchestra.run.trial047.stdout:Setting up cephadm (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:51.342 INFO:teuthology.orchestra.run.trial047.stdout:Adding system user cephadm....done 2026-02-25T20:27:51.348 INFO:teuthology.orchestra.run.trial047.stdout:usermod: no changes 2026-02-25T20:27:51.353 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-25T20:27:51.425 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-25T20:27:51.426 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-25T20:27:51.496 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-25T20:27:51.572 INFO:teuthology.orchestra.run.trial047.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-25T20:27:51.573 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-25T20:27:51.668 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-25T20:27:51.783 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-25T20:27:51.858 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-25T20:27:51.930 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-ceph-argparse (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:51.996 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-25T20:27:51.997 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-25T20:27:51.998 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-25T20:27:51.999 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-25T20:27:52.000 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-25T20:27:52.123 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-25T20:27:52.192 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libcephfs-proxy2 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:52.193 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-25T20:27:52.270 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-25T20:27:52.350 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-25T20:27:52.598 INFO:teuthology.orchestra.run.trial047.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-25T20:27:52.599 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-25T20:27:52.696 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-25T20:27:52.822 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-25T20:27:52.902 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-25T20:27:52.973 INFO:teuthology.orchestra.run.trial047.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-25T20:27:52.974 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-ceph-common (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:53.065 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-25T20:27:53.569 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-25T20:27:53.574 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-25T20:27:53.648 INFO:teuthology.orchestra.run.trial047.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-25T20:27:53.649 INFO:teuthology.orchestra.run.trial047.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-25T20:27:53.650 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-25T20:27:53.722 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-25T20:27:53.792 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-25T20:27:53.793 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-25T20:27:53.870 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-25T20:27:53.943 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-25T20:27:54.022 INFO:teuthology.orchestra.run.trial047.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-25T20:27:54.023 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-25T20:27:54.108 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-25T20:27:54.109 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-25T20:27:54.184 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-25T20:27:54.267 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-25T20:27:54.342 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-25T20:27:54.343 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-25T20:27:54.478 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-25T20:27:54.549 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-25T20:27:54.550 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-25T20:27:54.626 INFO:teuthology.orchestra.run.trial047.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-25T20:27:54.631 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-25T20:27:54.749 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-25T20:27:54.750 INFO:teuthology.orchestra.run.trial047.stdout:Setting up librados2 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:54.751 INFO:teuthology.orchestra.run.trial047.stdout:Setting up librgw2 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:54.752 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:54.753 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-25T20:27:55.280 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libcephfs2 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.281 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libradosstriper1 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.282 INFO:teuthology.orchestra.run.trial047.stdout:Setting up librbd1 (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.283 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-mgr-modules-core (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.283 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-fuse (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.362 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-25T20:27:55.363 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-25T20:27:55.742 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libcephfs-dev (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.743 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-rados (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.744 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libcephfs-daemon (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.744 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-rbd (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.745 INFO:teuthology.orchestra.run.trial047.stdout:Setting up rbd-fuse (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.746 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-rgw (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.747 INFO:teuthology.orchestra.run.trial047.stdout:Setting up python3-cephfs (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.748 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-common (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:55.777 INFO:teuthology.orchestra.run.trial047.stdout:Adding group ceph....done 2026-02-25T20:27:55.810 INFO:teuthology.orchestra.run.trial047.stdout:Adding system user ceph....done 2026-02-25T20:27:55.821 INFO:teuthology.orchestra.run.trial047.stdout:Setting system user ceph properties....done 2026-02-25T20:27:55.827 INFO:teuthology.orchestra.run.trial047.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-25T20:27:55.910 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-25T20:27:56.182 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-25T20:27:56.517 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-test (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:56.518 INFO:teuthology.orchestra.run.trial047.stdout:Setting up radosgw (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:56.752 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-25T20:27:56.752 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-25T20:27:57.057 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-base (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:57.174 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-25T20:27:57.519 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-mds (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:57.578 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-25T20:27:57.578 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-25T20:27:57.907 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-mgr (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:57.977 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-25T20:27:57.977 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-25T20:27:58.305 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:58.306 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-osd-classic (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:58.323 INFO:teuthology.orchestra.run.trial047.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-25T20:27:58.332 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:58.343 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-mon (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:58.416 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-25T20:27:58.416 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-25T20:27:58.776 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-mgr-cephadm (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:58.787 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-mgr-dashboard (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:58.798 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-osd (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:58.877 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-25T20:27:58.878 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-25T20:27:59.216 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:59.216 INFO:teuthology.orchestra.run.trial047.stdout:Setting up ceph-volume (20.3.0-5580-g506b402a-1jammy) ... 2026-02-25T20:27:59.326 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:27:59.413 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-25T20:28:00.106 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:00.106 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:00.106 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:00.107 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:00.947 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:00.956 DEBUG:teuthology.parallel:result is None 2026-02-25T20:28:00.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=506b402a3d3a240d0bfe073b4769eaffdf84497b 2026-02-25T20:28:01.139 DEBUG:teuthology.orchestra.run.trial047:> dpkg-query -W -f '${Version}' ceph 2026-02-25T20:28:01.149 INFO:teuthology.orchestra.run.trial047.stdout:20.3.0-5580-g506b402a-1jammy 2026-02-25T20:28:01.150 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5580-g506b402a-1jammy 2026-02-25T20:28:01.150 INFO:teuthology.task.install:The correct ceph version 20.3.0-5580-g506b402a-1jammy is installed. 2026-02-25T20:28:01.152 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-25T20:28:01.152 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:01.152 DEBUG:teuthology.orchestra.run.trial047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T20:28:01.199 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-25T20:28:01.199 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:01.199 DEBUG:teuthology.orchestra.run.trial047:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T20:28:01.254 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T20:28:01.302 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-25T20:28:01.302 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:01.303 DEBUG:teuthology.orchestra.run.trial047:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T20:28:01.351 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T20:28:01.402 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-25T20:28:01.403 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:01.403 DEBUG:teuthology.orchestra.run.trial047:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T20:28:01.454 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T20:28:01.502 INFO:teuthology.run_tasks:Running task ceph... 2026-02-25T20:28:01.618 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-25T20:28:01.618 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod 777 /var/log/ceph 2026-02-25T20:28:01.626 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-25T20:28:01.626 DEBUG:teuthology.orchestra.run.trial047:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T20:28:01.674 INFO:tasks.ceph:Creating extra log directories... 2026-02-25T20:28:01.674 DEBUG:teuthology.orchestra.run.trial047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T20:28:01.731 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-25T20:28:01.731 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw keystone accepted admin roles': 'admin', 'rgw keystone accepted roles': 'admin,member', 'rgw keystone admin domain': 'Default', 'rgw keystone admin password': 'ADMIN', 'rgw keystone admin project': 'admin', 'rgw keystone admin user': 'admin', 'rgw keystone api version': 3, 'rgw keystone implicit tenants': True, 'rgw s3 auth order': 'sts, external, local', 'rgw s3 auth use keystone': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw swift account in url': True, 'rgw swift enforce content length': True, 'rgw swift versioning enabled': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-25T20:28:01.731 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70594', 'branch': 'wip-rocky10-branch-of-the-day-2026-02-24-1771941190', 'description': 'rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/s3/{auth-order/external-local s3tests} ubuntu_latest}', 'email': 'aemerson@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '70594', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rocky10-branch-of-the-day-2026-02-24-1771941190'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw keystone accepted admin roles': 'admin', 'rgw keystone accepted roles': 'admin,member', 'rgw keystone admin domain': 'Default', 'rgw keystone admin password': 'ADMIN', 'rgw keystone admin project': 'admin', 'rgw keystone admin user': 'admin', 'rgw keystone api version': 3, 'rgw keystone implicit tenants': True, 'rgw s3 auth order': 'sts, external, local', 'rgw s3 auth use keystone': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw swift account in url': True, 'rgw swift enforce content length': True, 'rgw swift versioning enabled': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '506b402a3d3a240d0bfe073b4769eaffdf84497b'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'cephadm': {'distro-suffix': 'rockylinux-10'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '506b402a3d3a240d0bfe073b4769eaffdf84497b'}}, 'keystone': {'client.0': {'ec2 credentials': [{'project': 's3tests', 'user': 's3tests-main'}], 'projects': [{'description': 's3tests project', 'name': 's3tests'}], 'role-mappings': [{'name': 'member', 'project': 's3tests', 'user': 's3tests-main'}], 'roles': [{'name': 'member'}], 'users': [{'name': 's3tests-main', 'password': 'SECRET', 'project': 's3tests'}]}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master'}, 'workunit': {'branch': 'rocky101', 'sha1': '80c7315e5866ead938d7771844a338858c6ed0e3'}}, 'owner': 'scheduled_aemerson@soko04.front.sepia.ceph.com', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 6707, 'sha1': '506b402a3d3a240d0bfe073b4769eaffdf84497b', 'sleep_before_teardown': 0, 'subset': '1/130000', 'suite': 'rgw', 'suite_branch': 'rocky101', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '80c7315e5866ead938d7771844a338858c6ed0e3', 'targets': {'trial047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHWz1+X5Kfr0PPMNR7a4/ZT+QtVKC2I16MiPQe0OY/GcjztCrG0Vzc1gTqd32rI9pzwb1Ar1f7Qt3S7qQoIq9+I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'tox': ['client.0']}, {'keystone': {'client.0': {'force-branch': 'stable/2024.2', 'services': [{'description': 'Swift Service', 'name': 'swift', 'type': 'object-store'}]}}}, {'rgw': {'client.0': {'use-keystone-role': 'client.0'}}}, {'s3tests': {'client.0': {'keystone users': {'s3 main': {'client': 'client.0', 'project': 's3tests', 'user': 's3tests-main'}}, 'rgw_server': 'client.0'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-25_20:14:14', 'tube': 'trial', 'user': 'aemerson', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-25T20:28:01.732 DEBUG:teuthology.orchestra.run.trial047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T20:28:01.766 DEBUG:teuthology.orchestra.run.trial047:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T20:28:01.814 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:01.814 DEBUG:teuthology.orchestra.run.trial047:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T20:28:01.859 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T20:28:01.859 DEBUG:teuthology.orchestra.run.trial047:> stat /dev/vg_nvme/lv_1 2026-02-25T20:28:01.906 INFO:teuthology.orchestra.run.trial047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T20:28:01.906 INFO:teuthology.orchestra.run.trial047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T20:28:01.907 INFO:teuthology.orchestra.run.trial047.stdout:Device: 5h/5d Inode: 901 Links: 1 2026-02-25T20:28:01.907 INFO:teuthology.orchestra.run.trial047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T20:28:01.907 INFO:teuthology.orchestra.run.trial047.stdout:Access: 2026-02-25 20:22:53.587586209 +0000 2026-02-25T20:28:01.907 INFO:teuthology.orchestra.run.trial047.stdout:Modify: 2026-02-25 20:22:53.435588800 +0000 2026-02-25T20:28:01.907 INFO:teuthology.orchestra.run.trial047.stdout:Change: 2026-02-25 20:22:53.435588800 +0000 2026-02-25T20:28:01.907 INFO:teuthology.orchestra.run.trial047.stdout: Birth: - 2026-02-25T20:28:01.907 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T20:28:01.953 INFO:teuthology.orchestra.run.trial047.stderr:1+0 records in 2026-02-25T20:28:01.953 INFO:teuthology.orchestra.run.trial047.stderr:1+0 records out 2026-02-25T20:28:01.953 INFO:teuthology.orchestra.run.trial047.stderr:512 bytes copied, 0.000183347 s, 2.8 MB/s 2026-02-25T20:28:01.954 DEBUG:teuthology.orchestra.run.trial047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T20:28:02.000 DEBUG:teuthology.orchestra.run.trial047:> stat /dev/vg_nvme/lv_2 2026-02-25T20:28:02.046 INFO:teuthology.orchestra.run.trial047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T20:28:02.046 INFO:teuthology.orchestra.run.trial047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T20:28:02.046 INFO:teuthology.orchestra.run.trial047.stdout:Device: 5h/5d Inode: 925 Links: 1 2026-02-25T20:28:02.046 INFO:teuthology.orchestra.run.trial047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T20:28:02.047 INFO:teuthology.orchestra.run.trial047.stdout:Access: 2026-02-25 20:22:53.887581099 +0000 2026-02-25T20:28:02.047 INFO:teuthology.orchestra.run.trial047.stdout:Modify: 2026-02-25 20:22:53.743583554 +0000 2026-02-25T20:28:02.047 INFO:teuthology.orchestra.run.trial047.stdout:Change: 2026-02-25 20:22:53.743583554 +0000 2026-02-25T20:28:02.047 INFO:teuthology.orchestra.run.trial047.stdout: Birth: - 2026-02-25T20:28:02.047 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T20:28:02.093 INFO:teuthology.orchestra.run.trial047.stderr:1+0 records in 2026-02-25T20:28:02.093 INFO:teuthology.orchestra.run.trial047.stderr:1+0 records out 2026-02-25T20:28:02.093 INFO:teuthology.orchestra.run.trial047.stderr:512 bytes copied, 0.000178316 s, 2.9 MB/s 2026-02-25T20:28:02.094 DEBUG:teuthology.orchestra.run.trial047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T20:28:02.139 DEBUG:teuthology.orchestra.run.trial047:> stat /dev/vg_nvme/lv_3 2026-02-25T20:28:02.186 INFO:teuthology.orchestra.run.trial047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T20:28:02.186 INFO:teuthology.orchestra.run.trial047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T20:28:02.186 INFO:teuthology.orchestra.run.trial047.stdout:Device: 5h/5d Inode: 948 Links: 1 2026-02-25T20:28:02.187 INFO:teuthology.orchestra.run.trial047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T20:28:02.187 INFO:teuthology.orchestra.run.trial047.stdout:Access: 2026-02-25 20:22:54.203575716 +0000 2026-02-25T20:28:02.187 INFO:teuthology.orchestra.run.trial047.stdout:Modify: 2026-02-25 20:22:54.055578239 +0000 2026-02-25T20:28:02.187 INFO:teuthology.orchestra.run.trial047.stdout:Change: 2026-02-25 20:22:54.055578239 +0000 2026-02-25T20:28:02.187 INFO:teuthology.orchestra.run.trial047.stdout: Birth: - 2026-02-25T20:28:02.187 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T20:28:02.233 INFO:teuthology.orchestra.run.trial047.stderr:1+0 records in 2026-02-25T20:28:02.233 INFO:teuthology.orchestra.run.trial047.stderr:1+0 records out 2026-02-25T20:28:02.233 INFO:teuthology.orchestra.run.trial047.stderr:512 bytes copied, 0.000178045 s, 2.9 MB/s 2026-02-25T20:28:02.234 DEBUG:teuthology.orchestra.run.trial047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T20:28:02.284 DEBUG:teuthology.orchestra.run.trial047:> stat /dev/vg_nvme/lv_4 2026-02-25T20:28:02.330 INFO:teuthology.orchestra.run.trial047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T20:28:02.330 INFO:teuthology.orchestra.run.trial047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T20:28:02.330 INFO:teuthology.orchestra.run.trial047.stdout:Device: 5h/5d Inode: 985 Links: 1 2026-02-25T20:28:02.331 INFO:teuthology.orchestra.run.trial047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T20:28:02.331 INFO:teuthology.orchestra.run.trial047.stdout:Access: 2026-02-25 20:22:54.379572720 +0000 2026-02-25T20:28:02.331 INFO:teuthology.orchestra.run.trial047.stdout:Modify: 2026-02-25 20:22:54.375572786 +0000 2026-02-25T20:28:02.331 INFO:teuthology.orchestra.run.trial047.stdout:Change: 2026-02-25 20:22:54.375572786 +0000 2026-02-25T20:28:02.331 INFO:teuthology.orchestra.run.trial047.stdout: Birth: - 2026-02-25T20:28:02.331 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T20:28:02.377 INFO:teuthology.orchestra.run.trial047.stderr:1+0 records in 2026-02-25T20:28:02.378 INFO:teuthology.orchestra.run.trial047.stderr:1+0 records out 2026-02-25T20:28:02.378 INFO:teuthology.orchestra.run.trial047.stderr:512 bytes copied, 0.000163686 s, 3.1 MB/s 2026-02-25T20:28:02.379 DEBUG:teuthology.orchestra.run.trial047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T20:28:02.427 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-25T20:28:02.427 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-25T20:28:02.428 INFO:tasks.ceph:Generating config... 2026-02-25T20:28:02.430 INFO:tasks.ceph:[client] debug rgw = 20 2026-02-25T20:28:02.430 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2026-02-25T20:28:02.430 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2026-02-25T20:28:02.430 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2026-02-25T20:28:02.430 INFO:tasks.ceph:[client] rgw keystone accepted admin roles = admin 2026-02-25T20:28:02.430 INFO:tasks.ceph:[client] rgw keystone accepted roles = admin,member 2026-02-25T20:28:02.430 INFO:tasks.ceph:[client] rgw keystone admin domain = Default 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw keystone admin password = ADMIN 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw keystone admin project = admin 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw keystone admin user = admin 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw keystone api version = 3 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw keystone implicit tenants = True 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw s3 auth order = sts, external, local 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw s3 auth use keystone = True 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw swift account in url = True 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw swift enforce content length = True 2026-02-25T20:28:02.431 INFO:tasks.ceph:[client] rgw swift versioning enabled = True 2026-02-25T20:28:02.432 INFO:tasks.ceph:[client] setgroup = ceph 2026-02-25T20:28:02.432 INFO:tasks.ceph:[client] setuser = ceph 2026-02-25T20:28:02.432 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2026-02-25T20:28:02.432 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2026-02-25T20:28:02.432 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-25T20:28:02.432 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-25T20:28:02.432 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-25T20:28:02.432 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-25T20:28:02.432 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-25T20:28:02.432 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-25T20:28:02.432 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-25T20:28:02.432 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-25T20:28:02.433 INFO:tasks.ceph:Setting up mon.a... 2026-02-25T20:28:02.433 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-25T20:28:02.487 INFO:teuthology.orchestra.run.trial047.stdout:creating /etc/ceph/ceph.keyring 2026-02-25T20:28:02.490 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-25T20:28:02.553 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T20:28:02.602 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.47')] 2026-02-25T20:28:02.603 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.47', 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw keystone accepted admin roles': 'admin', 'rgw keystone accepted roles': 'admin,member', 'rgw keystone admin domain': 'Default', 'rgw keystone admin password': 'ADMIN', 'rgw keystone admin project': 'admin', 'rgw keystone admin user': 'admin', 'rgw keystone api version': 3, 'rgw keystone implicit tenants': True, 'rgw s3 auth order': 'sts, external, local', 'rgw s3 auth use keystone': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw swift account in url': True, 'rgw swift enforce content length': True, 'rgw swift versioning enabled': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2026-02-25T20:28:02.604 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:02.604 DEBUG:teuthology.orchestra.run.trial047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T20:28:02.647 DEBUG:teuthology.orchestra.run.trial047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.47 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-25T20:28:02.707 INFO:teuthology.orchestra.run.trial047.stderr:ignoring --setuser ceph since I am not root 2026-02-25T20:28:02.707 INFO:teuthology.orchestra.run.trial047.stderr:ignoring --setgroup ceph since I am not root 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:monmaptool: generated fsid 190d2ba5-842c-4712-a4c4-beed0d7d0fd9 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:setting min_mon_release = tentacle 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:epoch 0 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:fsid 190d2ba5-842c-4712-a4c4-beed0d7d0fd9 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:last_changed 2026-02-25T20:28:02.718296+0000 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:created 2026-02-25T20:28:02.718296+0000 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:min_mon_release 20 (tentacle) 2026-02-25T20:28:02.708 INFO:teuthology.orchestra.run.trial047.stdout:election_strategy: 1 2026-02-25T20:28:02.709 INFO:teuthology.orchestra.run.trial047.stdout:0: [v2:10.20.193.47:3300/0,v1:10.20.193.47:6789/0] mon.a 2026-02-25T20:28:02.709 INFO:teuthology.orchestra.run.trial047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-25T20:28:02.710 DEBUG:teuthology.orchestra.run.trial047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T20:28:02.754 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 190d2ba5-842c-4712-a4c4-beed0d7d0fd9... 2026-02-25T20:28:02.755 DEBUG:teuthology.orchestra.run.trial047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T20:28:02.814 INFO:teuthology.orchestra.run.trial047.stdout:[global] 2026-02-25T20:28:02.814 INFO:teuthology.orchestra.run.trial047.stdout: chdir = "" 2026-02-25T20:28:02.814 INFO:teuthology.orchestra.run.trial047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T20:28:02.814 INFO:teuthology.orchestra.run.trial047.stdout: auth supported = cephx 2026-02-25T20:28:02.814 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: filestore xattr use omap = true 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: mon clock drift allowed = 1.000 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: osd crush chooseleaf type = 0 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: auth debug = true 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: ms die on old message = true 2026-02-25T20:28:02.815 INFO:teuthology.orchestra.run.trial047.stdout: ms die on bug = true 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: mon pg warn max object skew = 0 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: osd pool default size = 2 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: mon osd allow primary affinity = true 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: mon osd allow pg remap = true 2026-02-25T20:28:02.816 INFO:teuthology.orchestra.run.trial047.stdout: mon warn on legacy crush tunables = false 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: mon warn on crush straw calc version zero = false 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: mon warn on no sortbitwise = false 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: mon warn on osd down out interval zero = false 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: mon warn on too few osds = false 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: mon_allow_pool_size_one = true 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: osd default data pool replay window = 5 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.817 INFO:teuthology.orchestra.run.trial047.stdout: mon allow pool delete = true 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: mon cluster log file level = debug 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: debug asserts on shutdown = true 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: mon health detail to clog = false 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: mon host = 10.20.193.47 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: osd_max_pg_log_entries = 10 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: osd_min_pg_log_entries = 10 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: fsid = 190d2ba5-842c-4712-a4c4-beed0d7d0fd9 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout:[osd] 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: osd journal size = 100 2026-02-25T20:28:02.818 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd scrub load threshold = 5.0 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd scrub max interval = 600 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd mclock profile = high_recovery_ops 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd recover clone overlap = true 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd recovery max chunk = 1048576 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd debug shutdown = true 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd debug op order = true 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd debug verify stray on activate = true 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd debug trim objects = true 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.819 INFO:teuthology.orchestra.run.trial047.stdout: osd open classes on start = true 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: osd debug pg log writeout = true 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: osd deep scrub update digest min age = 30 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: osd map max advance = 10 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: journal zero on create = true 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: filestore ondisk finisher threads = 3 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: filestore apply finisher threads = 3 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: bdev debug aio = true 2026-02-25T20:28:02.820 INFO:teuthology.orchestra.run.trial047.stdout: osd debug misdirected ops = true 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: debug ms = 1 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: debug osd = 20 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: osd shutdown pgref assert = True 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout:[mgr] 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: debug ms = 1 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: debug mgr = 20 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: debug mon = 20 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: debug auth = 20 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: mon reweight min pgs per osd = 4 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: mon reweight min bytes per osd = 10 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: mgr/telemetry/nag = false 2026-02-25T20:28:02.821 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout:[mon] 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: debug ms = 1 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: debug mon = 20 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: debug paxos = 20 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: debug auth = 20 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: mon data avail warn = 5 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: mon mgr mkfs grace = 240 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: mon reweight min pgs per osd = 4 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: mon osd reporter subtree level = osd 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: mon osd prime pg temp = true 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: mon reweight min bytes per osd = 10 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.822 INFO:teuthology.orchestra.run.trial047.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: # 1m isn't quite enough 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: mon_down_mkfs_grace = 2m 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: mon_warn_on_filestore_osds = false 2026-02-25T20:28:02.823 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout:[client] 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: rgw cache enabled = true 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: rgw enable ops log = true 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: rgw enable usage log = true 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: debug rgw = 20 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: rgw crypt require ssl = False 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: rgw crypt s3 kms backend = testing 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: rgw keystone accepted admin roles = admin 2026-02-25T20:28:02.824 INFO:teuthology.orchestra.run.trial047.stdout: rgw keystone accepted roles = "admin,member" 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw keystone admin domain = Default 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw keystone admin password = ADMIN 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw keystone admin project = admin 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw keystone admin user = admin 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw keystone api version = 3 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw keystone implicit tenants = True 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw s3 auth order = "sts, external, local" 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw s3 auth use keystone = True 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw s3 auth use sts = True 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw sts key = abcdefghijklmnop 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw swift account in url = True 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw swift enforce content length = True 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: rgw swift versioning enabled = True 2026-02-25T20:28:02.825 INFO:teuthology.orchestra.run.trial047.stdout: setgroup = ceph 2026-02-25T20:28:02.826 INFO:teuthology.orchestra.run.trial047.stdout: setuser = ceph 2026-02-25T20:28:02.826 INFO:teuthology.orchestra.run.trial047.stdout:[mon.a] 2026-02-25T20:28:02.827 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-25T20:28:02.827 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-25T20:28:02.897 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-25T20:28:02.897 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:02.898 DEBUG:teuthology.orchestra.run.trial047:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-25T20:28:02.943 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:02.943 DEBUG:teuthology.orchestra.run.trial047:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-25T20:28:02.990 INFO:tasks.ceph:Sending monmap to node ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:02.990 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:02.991 DEBUG:teuthology.orchestra.run.trial047:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T20:28:02.991 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T20:28:03.044 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:03.044 DEBUG:teuthology.orchestra.run.trial047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T20:28:03.091 INFO:tasks.ceph:Setting up mon nodes... 2026-02-25T20:28:03.091 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-25T20:28:03.091 DEBUG:teuthology.orchestra.run.trial047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T20:28:03.156 INFO:teuthology.orchestra.run.trial047.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T20:28:03.158 INFO:tasks.ceph:Setting up mds nodes... 2026-02-25T20:28:03.158 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-25T20:28:03.159 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-25T20:28:03.215 INFO:teuthology.orchestra.run.trial047.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-25T20:28:03.222 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-25T20:28:03.222 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-25T20:28:03.222 DEBUG:teuthology.orchestra.run.trial047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-25T20:28:03.270 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-25T20:28:03.270 INFO:tasks.ceph:role: osd.0 2026-02-25T20:28:03.270 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:03.270 DEBUG:teuthology.orchestra.run.trial047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T20:28:03.319 INFO:teuthology.orchestra.run.trial047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout: = sunit=0 swidth=0 blks 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T20:28:03.320 INFO:teuthology.orchestra.run.trial047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T20:28:03.894 INFO:teuthology.orchestra.run.trial047.stdout:Discarding blocks...Done. 2026-02-25T20:28:03.895 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial047.front.sepia.ceph.com -o noatime 2026-02-25T20:28:03.895 DEBUG:teuthology.orchestra.run.trial047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-25T20:28:03.956 DEBUG:teuthology.orchestra.run.trial047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-25T20:28:04.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T20:28:04.004 INFO:teuthology.orchestra.run.trial047.stderr:sudo: /sbin/restorecon: command not found 2026-02-25T20:28:04.005 DEBUG:teuthology.orchestra.run.trial047:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-25T20:28:04.054 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-25T20:28:04.055 INFO:tasks.ceph:role: osd.1 2026-02-25T20:28:04.055 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:04.055 DEBUG:teuthology.orchestra.run.trial047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T20:28:04.108 INFO:teuthology.orchestra.run.trial047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T20:28:04.108 INFO:teuthology.orchestra.run.trial047.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T20:28:04.108 INFO:teuthology.orchestra.run.trial047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T20:28:04.108 INFO:teuthology.orchestra.run.trial047.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-25T20:28:04.108 INFO:teuthology.orchestra.run.trial047.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T20:28:04.109 INFO:teuthology.orchestra.run.trial047.stdout: = sunit=0 swidth=0 blks 2026-02-25T20:28:04.109 INFO:teuthology.orchestra.run.trial047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T20:28:04.109 INFO:teuthology.orchestra.run.trial047.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T20:28:04.109 INFO:teuthology.orchestra.run.trial047.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T20:28:04.109 INFO:teuthology.orchestra.run.trial047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T20:28:04.675 INFO:teuthology.orchestra.run.trial047.stdout:Discarding blocks...Done. 2026-02-25T20:28:04.677 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial047.front.sepia.ceph.com -o noatime 2026-02-25T20:28:04.677 DEBUG:teuthology.orchestra.run.trial047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-25T20:28:04.736 DEBUG:teuthology.orchestra.run.trial047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-25T20:28:04.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T20:28:04.789 INFO:teuthology.orchestra.run.trial047.stderr:sudo: /sbin/restorecon: command not found 2026-02-25T20:28:04.789 DEBUG:teuthology.orchestra.run.trial047:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-25T20:28:04.838 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-25T20:28:04.838 INFO:tasks.ceph:role: osd.2 2026-02-25T20:28:04.838 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:04.838 DEBUG:teuthology.orchestra.run.trial047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T20:28:04.888 INFO:teuthology.orchestra.run.trial047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T20:28:04.888 INFO:teuthology.orchestra.run.trial047.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T20:28:04.888 INFO:teuthology.orchestra.run.trial047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T20:28:04.888 INFO:teuthology.orchestra.run.trial047.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-25T20:28:04.888 INFO:teuthology.orchestra.run.trial047.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T20:28:04.889 INFO:teuthology.orchestra.run.trial047.stdout: = sunit=0 swidth=0 blks 2026-02-25T20:28:04.889 INFO:teuthology.orchestra.run.trial047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T20:28:04.889 INFO:teuthology.orchestra.run.trial047.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T20:28:04.889 INFO:teuthology.orchestra.run.trial047.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T20:28:04.889 INFO:teuthology.orchestra.run.trial047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T20:28:05.452 INFO:teuthology.orchestra.run.trial047.stdout:Discarding blocks...Done. 2026-02-25T20:28:05.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial047.front.sepia.ceph.com -o noatime 2026-02-25T20:28:05.454 DEBUG:teuthology.orchestra.run.trial047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-25T20:28:05.511 DEBUG:teuthology.orchestra.run.trial047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-25T20:28:05.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T20:28:05.560 INFO:teuthology.orchestra.run.trial047.stderr:sudo: /sbin/restorecon: command not found 2026-02-25T20:28:05.561 DEBUG:teuthology.orchestra.run.trial047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T20:28:05.627 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:05.635+0000 7f1e14b96a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-25T20:28:05.628 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:05.635+0000 7f1e14b96a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-25T20:28:05.628 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:05.635+0000 7f1e14b96a40 -1 bdev(0x56335eead800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-25T20:28:05.628 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:05.635+0000 7f1e14b96a40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-25T20:28:06.283 DEBUG:teuthology.orchestra.run.trial047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-25T20:28:06.339 DEBUG:teuthology.orchestra.run.trial047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T20:28:06.402 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:06.407+0000 7f0ecab40a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-25T20:28:06.403 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:06.411+0000 7f0ecab40a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-25T20:28:06.403 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:06.411+0000 7f0ecab40a40 -1 bdev(0x564aebcad800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-25T20:28:06.403 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:06.411+0000 7f0ecab40a40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-25T20:28:07.028 DEBUG:teuthology.orchestra.run.trial047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-25T20:28:07.079 DEBUG:teuthology.orchestra.run.trial047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T20:28:07.143 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:07.151+0000 7f3a211c0a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-25T20:28:07.143 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:07.151+0000 7f3a211c0a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-25T20:28:07.144 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:07.151+0000 7f3a211c0a40 -1 bdev(0x56186b99f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-25T20:28:07.144 INFO:teuthology.orchestra.run.trial047.stderr:2026-02-25T20:28:07.151+0000 7f3a211c0a40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-25T20:28:07.819 DEBUG:teuthology.orchestra.run.trial047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-25T20:28:07.870 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-25T20:28:07.871 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:07.871 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-25T20:28:07.926 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:07.926 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-25T20:28:07.978 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:07.979 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-25T20:28:08.033 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:08.034 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-25T20:28:08.081 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:08.082 DEBUG:teuthology.orchestra.run.trial047:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-25T20:28:08.126 INFO:tasks.ceph:Adding keys to all mons... 2026-02-25T20:28:08.126 DEBUG:teuthology.orchestra.run.trial047:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout:[mgr.x] 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout: key = AQBTW59ppYT4CRAAwepmD0auABbIZrlo8+StdA== 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout:[osd.0] 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout: key = AQBVW59pdaQWJhAAj2vr9gSsTlp2kacoNHcDCQ== 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout:[osd.1] 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout: key = AQBWW59pHGqqGBAAK8GKWFmfkkSTq4Jnp9byCQ== 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout:[osd.2] 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout: key = AQBXW59psW81CRAAU453llp3lqvwIQmoYsXbVw== 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout:[client.0] 2026-02-25T20:28:08.176 INFO:teuthology.orchestra.run.trial047.stdout: key = AQBTW59p9zJ+DRAAcVmRJKJA3TwxA7beBGLfQw== 2026-02-25T20:28:08.177 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T20:28:08.239 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T20:28:08.302 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T20:28:08.370 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T20:28:08.434 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T20:28:08.498 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-25T20:28:08.498 DEBUG:teuthology.orchestra.run.trial047:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-25T20:28:08.549 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T20:28:08.615 DEBUG:teuthology.orchestra.run.trial047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-25T20:28:08.670 DEBUG:teuthology.orchestra.run.trial047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T20:28:08.713 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-25T20:28:08.714 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-25T20:28:08.714 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-25T20:28:08.755 INFO:tasks.ceph.mon.a:Started 2026-02-25T20:28:08.755 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-25T20:28:08.755 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-25T20:28:08.756 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-25T20:28:08.758 INFO:tasks.ceph.mgr.x:Started 2026-02-25T20:28:08.758 DEBUG:tasks.ceph:set 0 configs 2026-02-25T20:28:08.758 DEBUG:teuthology.orchestra.run.trial047:> sudo ceph --cluster ceph config dump 2026-02-25T20:28:08.882 INFO:teuthology.orchestra.run.trial047.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-25T20:28:08.892 INFO:tasks.ceph:Setting crush tunables to default 2026-02-25T20:28:08.892 DEBUG:teuthology.orchestra.run.trial047:> sudo ceph --cluster ceph osd crush tunables default 2026-02-25T20:28:08.985 INFO:teuthology.orchestra.run.trial047.stderr:adjusted tunables profile to default 2026-02-25T20:28:08.994 INFO:tasks.ceph:check_enable_crimson: False 2026-02-25T20:28:08.994 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-25T20:28:08.994 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:08.994 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-25T20:28:09.002 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:09.002 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-25T20:28:09.016 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.024+0000 7ffaed19b280 -1 mgr[py] Loading module balancer in main interpreter 2026-02-25T20:28:09.023 DEBUG:teuthology.orchestra.run.trial047:> set -ex 2026-02-25T20:28:09.023 DEBUG:teuthology.orchestra.run.trial047:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-25T20:28:09.072 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.080+0000 7ffaed19b280 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-25T20:28:09.073 DEBUG:teuthology.orchestra.run.trial047:> sudo ceph --cluster ceph osd new ded3f6dc-33b9-477a-a63e-93006c465084 0 2026-02-25T20:28:09.074 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.084+0000 7ffaed19b280 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-25T20:28:09.087 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.096+0000 7ffaed19b280 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-25T20:28:09.131 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.140+0000 7ffaed19b280 -1 mgr[py] Loading module smb in main interpreter 2026-02-25T20:28:09.168 INFO:teuthology.orchestra.run.trial047.stdout:0 2026-02-25T20:28:09.177 DEBUG:teuthology.orchestra.run.trial047:> sudo ceph --cluster ceph osd new 7699b91f-4589-432f-afdc-b6eabcc064ff 1 2026-02-25T20:28:09.201 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.208+0000 7ffaed19b280 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-25T20:28:09.203 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.212+0000 7ffaed19b280 -1 mgr[py] Loading module status in main interpreter 2026-02-25T20:28:09.204 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.212+0000 7ffaed19b280 -1 mgr[py] Loading module nfs in main interpreter 2026-02-25T20:28:09.214 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.224+0000 7ffaed19b280 -1 mgr[py] Loading module localpool in main interpreter 2026-02-25T20:28:09.215 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.224+0000 7ffaed19b280 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-25T20:28:09.297 INFO:teuthology.orchestra.run.trial047.stdout:1 2026-02-25T20:28:09.301 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.308+0000 7ffaed19b280 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-25T20:28:09.306 DEBUG:teuthology.orchestra.run.trial047:> sudo ceph --cluster ceph osd new 89bae13a-5285-484a-a28b-ede7f3252546 2 2026-02-25T20:28:09.433 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.440+0000 7ffaed19b280 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-25T20:28:09.433 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.440+0000 7ffaed19b280 -1 mgr[py] Loading module stats in main interpreter 2026-02-25T20:28:09.436 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.444+0000 7ffaed19b280 -1 mgr[py] Loading module insights in main interpreter 2026-02-25T20:28:09.438 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.448+0000 7ffaed19b280 -1 mgr[py] Loading module crash in main interpreter 2026-02-25T20:28:09.440 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.448+0000 7ffaed19b280 -1 mgr[py] Loading module selftest in main interpreter 2026-02-25T20:28:09.443 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.452+0000 7ffaed19b280 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-25T20:28:09.450 INFO:teuthology.orchestra.run.trial047.stdout:2 2026-02-25T20:28:09.450 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.460+0000 7ffaed19b280 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-25T20:28:09.459 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-25T20:28:09.460 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-25T20:28:09.462 INFO:tasks.ceph.osd.0:Started 2026-02-25T20:28:09.462 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-25T20:28:09.462 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-25T20:28:09.464 INFO:tasks.ceph.osd.1:Started 2026-02-25T20:28:09.464 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-25T20:28:09.464 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-25T20:28:09.466 INFO:tasks.ceph.osd.2:Started 2026-02-25T20:28:09.466 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T20:28:09.467 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.476+0000 7ffaed19b280 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-25T20:28:09.476 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.484+0000 7ffaed19b280 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-25T20:28:09.477 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.484+0000 7ffaed19b280 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-25T20:28:09.494 INFO:tasks.ceph.mgr.x.trial047.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-25T20:28:09.516 INFO:tasks.ceph.mgr.x.trial047.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-25T20:28:09.521 INFO:tasks.ceph.mgr.x.trial047.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-25T20:28:09.566 INFO:tasks.ceph.mgr.x.trial047.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-25T20:28:09.567 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:09.567 INFO:teuthology.orchestra.run.trial047.stdout:{"epoch":5,"fsid":"190d2ba5-842c-4712-a4c4-beed0d7d0fd9","created":"2026-02-25T20:28:08.854968+0000","modified":"2026-02-25T20:28:09.461436+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T20:28:09.461436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ded3f6dc-33b9-477a-a63e-93006c465084","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7699b91f-4589-432f-afdc-b6eabcc064ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"89bae13a-5285-484a-a28b-ede7f3252546","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T20:28:09.572 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.580+0000 7ffaed19b280 -1 mgr[py] Loading module influx in main interpreter 2026-02-25T20:28:09.574 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.584+0000 7ffaed19b280 -1 mgr[py] Loading module alerts in main interpreter 2026-02-25T20:28:09.576 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.584+0000 7ffaed19b280 -1 mgr[py] Loading module volumes in main interpreter 2026-02-25T20:28:09.578 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-25T20:28:09.578 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-25T20:28:09.603 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.612+0000 7ffaed19b280 -1 mgr[py] Loading module rgw in main interpreter 2026-02-25T20:28:09.607 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.616+0000 7ffaed19b280 -1 mgr[py] Loading module iostat in main interpreter 2026-02-25T20:28:09.608 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.616+0000 7ffaed19b280 -1 mgr[py] Loading module progress in main interpreter 2026-02-25T20:28:09.611 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.620+0000 7ffaed19b280 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-25T20:28:09.614 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.620+0000 7ffaed19b280 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-25T20:28:09.728 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:09.736+0000 7ffaed19b280 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-25T20:28:09.792 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.792 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.792 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.793 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.794 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.794 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.794 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.794 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.794 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.794 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.794 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.795 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.795 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.796 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.796 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.796 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.796 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-25T20:28:09.796 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.796 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.796 INFO:tasks.ceph.mgr.x.trial047.stderr:DEBUG:mgr_util:locked 2026-02-25T20:28:09.881 DEBUG:teuthology.orchestra.run.trial047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T20:28:09.967 INFO:teuthology.misc.health.trial047.stdout: 2026-02-25T20:28:09.967 INFO:teuthology.misc.health.trial047.stdout:{"epoch":5,"fsid":"190d2ba5-842c-4712-a4c4-beed0d7d0fd9","created":"2026-02-25T20:28:08.854968+0000","modified":"2026-02-25T20:28:09.461436+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T20:28:09.461436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ded3f6dc-33b9-477a-a63e-93006c465084","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7699b91f-4589-432f-afdc-b6eabcc064ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"89bae13a-5285-484a-a28b-ede7f3252546","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T20:28:09.977 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-25T20:28:10.043 INFO:tasks.ceph.osd.2.trial047.stderr:2026-02-25T20:28:10.052+0000 7f6aa9c45a40 -1 Falling back to public interface 2026-02-25T20:28:10.051 INFO:tasks.ceph.osd.0.trial047.stderr:2026-02-25T20:28:10.060+0000 7f28d5a34a40 -1 Falling back to public interface 2026-02-25T20:28:10.075 INFO:tasks.ceph.osd.1.trial047.stderr:2026-02-25T20:28:10.084+0000 7ff3debe9a40 -1 Falling back to public interface 2026-02-25T20:28:10.691 INFO:tasks.ceph.osd.0.trial047.stderr:2026-02-25T20:28:10.700+0000 7f28d5a34a40 -1 osd.0 0 log_to_monitors true 2026-02-25T20:28:10.694 INFO:tasks.ceph.osd.2.trial047.stderr:2026-02-25T20:28:10.704+0000 7f6aa9c45a40 -1 osd.2 0 log_to_monitors true 2026-02-25T20:28:10.750 INFO:tasks.ceph.osd.1.trial047.stderr:2026-02-25T20:28:10.760+0000 7ff3debe9a40 -1 osd.1 0 log_to_monitors true 2026-02-25T20:28:10.760 INFO:tasks.ceph.mgr.x.trial047.stderr:2026-02-25T20:28:10.768+0000 7ffa17329640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-25T20:28:12.044 INFO:tasks.ceph.osd.2.trial047.stderr:2026-02-25T20:28:12.052+0000 7f6aa5bef640 -1 osd.2 0 waiting for initial osdmap 2026-02-25T20:28:12.076 INFO:tasks.ceph.osd.2.trial047.stderr:2026-02-25T20:28:12.084+0000 7f6a9d2be640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T20:28:12.222 INFO:tasks.ceph.osd.0.trial047.stderr:2026-02-25T20:28:12.232+0000 7f28d19de640 -1 osd.0 0 waiting for initial osdmap 2026-02-25T20:28:12.224 INFO:tasks.ceph.osd.0.trial047.stderr:2026-02-25T20:28:12.232+0000 7f28c90ad640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T20:28:15.208 INFO:tasks.ceph.osd.1.trial047.stderr:2026-02-25T20:28:15.216+0000 7ff3dab93640 -1 osd.1 0 waiting for initial osdmap 2026-02-25T20:28:15.210 INFO:tasks.ceph.osd.1.trial047.stderr:2026-02-25T20:28:15.220+0000 7ff3d2262640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T20:28:16.279 DEBUG:teuthology.orchestra.run.trial047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T20:28:16.430 INFO:teuthology.misc.health.trial047.stdout: 2026-02-25T20:28:16.430 INFO:teuthology.misc.health.trial047.stdout:{"epoch":11,"fsid":"190d2ba5-842c-4712-a4c4-beed0d7d0fd9","created":"2026-02-25T20:28:08.854968+0000","modified":"2026-02-25T20:28:16.089044+0000","last_up_change":"2026-02-25T20:28:16.089044+0000","last_in_change":"2026-02-25T20:28:09.461436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T20:28:13.801114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded3f6dc-33b9-477a-a63e-93006c465084","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6810","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6811","nonce":3432499718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6812","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6813","nonce":3432499718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6816","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6817","nonce":3432499718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6814","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6815","nonce":3432499718}]},"public_addr":"10.20.193.47:6811/3432499718","cluster_addr":"10.20.193.47:6813/3432499718","heartbeat_back_addr":"10.20.193.47:6817/3432499718","heartbeat_front_addr":"10.20.193.47:6815/3432499718","state":["exists","up"]},{"osd":1,"uuid":"7699b91f-4589-432f-afdc-b6eabcc064ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6818","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6819","nonce":653838958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6820","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6821","nonce":653838958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6824","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6825","nonce":653838958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6822","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6823","nonce":653838958}]},"public_addr":"10.20.193.47:6819/653838958","cluster_addr":"10.20.193.47:6821/653838958","heartbeat_back_addr":"10.20.193.47:6825/653838958","heartbeat_front_addr":"10.20.193.47:6823/653838958","state":["exists","up"]},{"osd":2,"uuid":"89bae13a-5285-484a-a28b-ede7f3252546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6802","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6803","nonce":2941176462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6804","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6805","nonce":2941176462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6808","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6809","nonce":2941176462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6806","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6807","nonce":2941176462}]},"public_addr":"10.20.193.47:6803/2941176462","cluster_addr":"10.20.193.47:6805/2941176462","heartbeat_back_addr":"10.20.193.47:6809/2941176462","heartbeat_front_addr":"10.20.193.47:6807/2941176462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.716264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.664493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T20:28:16.440 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-25T20:28:16.440 INFO:tasks.ceph:Creating RBD pool 2026-02-25T20:28:16.440 DEBUG:teuthology.orchestra.run.trial047:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-25T20:28:17.177 INFO:teuthology.orchestra.run.trial047.stderr:pool 'rbd' created 2026-02-25T20:28:17.191 DEBUG:teuthology.orchestra.run.trial047:> rbd --cluster ceph pool init rbd 2026-02-25T20:28:17.207 INFO:teuthology.orchestra.run.trial047.stderr:ignoring --setuser ceph since I am not root 2026-02-25T20:28:17.207 INFO:teuthology.orchestra.run.trial047.stderr:ignoring --setgroup ceph since I am not root 2026-02-25T20:28:20.191 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-25T20:28:20.192 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-25T20:28:20.193 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-25T20:28:20.384 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:20.395 INFO:teuthology.orchestra.run.trial047.stdout:[{"version":3,"timestamp":"2026-02-25T20:28:12.234889+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"61780.836314"}]}] 2026-02-25T20:28:20.396 INFO:tasks.ceph_manager:config epoch is 3 2026-02-25T20:28:20.396 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-25T20:28:20.396 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-25T20:28:20.396 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-25T20:28:20.572 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:20.584 INFO:teuthology.orchestra.run.trial047.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6800","nonce":2500516755},{"type":"v1","addr":"10.20.193.47:6801","nonce":2500516755}]},"active_addr":"10.20.193.47:6801/2500516755","active_change":"2026-02-25T20:28:09.766529+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.7","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.47:0","nonce":1030586057}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.47:0","nonce":19602741}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.47:0","nonce":312481678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.47:0","nonce":1436416197}]}]} 2026-02-25T20:28:20.588 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-25T20:28:20.588 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-25T20:28:20.588 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T20:28:20.744 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:20.744 INFO:teuthology.orchestra.run.trial047.stdout:{"epoch":15,"fsid":"190d2ba5-842c-4712-a4c4-beed0d7d0fd9","created":"2026-02-25T20:28:08.854968+0000","modified":"2026-02-25T20:28:20.193710+0000","last_up_change":"2026-02-25T20:28:16.089044+0000","last_in_change":"2026-02-25T20:28:09.461436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T20:28:13.801114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T20:28:16.605664+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded3f6dc-33b9-477a-a63e-93006c465084","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6810","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6811","nonce":3432499718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6812","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6813","nonce":3432499718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6816","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6817","nonce":3432499718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6814","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6815","nonce":3432499718}]},"public_addr":"10.20.193.47:6811/3432499718","cluster_addr":"10.20.193.47:6813/3432499718","heartbeat_back_addr":"10.20.193.47:6817/3432499718","heartbeat_front_addr":"10.20.193.47:6815/3432499718","state":["exists","up"]},{"osd":1,"uuid":"7699b91f-4589-432f-afdc-b6eabcc064ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6818","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6819","nonce":653838958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6820","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6821","nonce":653838958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6824","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6825","nonce":653838958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6822","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6823","nonce":653838958}]},"public_addr":"10.20.193.47:6819/653838958","cluster_addr":"10.20.193.47:6821/653838958","heartbeat_back_addr":"10.20.193.47:6825/653838958","heartbeat_front_addr":"10.20.193.47:6823/653838958","state":["exists","up"]},{"osd":2,"uuid":"89bae13a-5285-484a-a28b-ede7f3252546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6802","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6803","nonce":2941176462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6804","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6805","nonce":2941176462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6808","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6809","nonce":2941176462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6806","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6807","nonce":2941176462}]},"public_addr":"10.20.193.47:6803/2941176462","cluster_addr":"10.20.193.47:6805/2941176462","heartbeat_back_addr":"10.20.193.47:6809/2941176462","heartbeat_front_addr":"10.20.193.47:6807/2941176462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.716264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.752673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.664493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T20:28:20.755 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-25T20:28:20.755 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T20:28:20.911 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:20.911 INFO:teuthology.orchestra.run.trial047.stdout:{"epoch":15,"fsid":"190d2ba5-842c-4712-a4c4-beed0d7d0fd9","created":"2026-02-25T20:28:08.854968+0000","modified":"2026-02-25T20:28:20.193710+0000","last_up_change":"2026-02-25T20:28:16.089044+0000","last_in_change":"2026-02-25T20:28:09.461436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T20:28:13.801114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T20:28:16.605664+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded3f6dc-33b9-477a-a63e-93006c465084","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6810","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6811","nonce":3432499718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6812","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6813","nonce":3432499718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6816","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6817","nonce":3432499718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6814","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6815","nonce":3432499718}]},"public_addr":"10.20.193.47:6811/3432499718","cluster_addr":"10.20.193.47:6813/3432499718","heartbeat_back_addr":"10.20.193.47:6817/3432499718","heartbeat_front_addr":"10.20.193.47:6815/3432499718","state":["exists","up"]},{"osd":1,"uuid":"7699b91f-4589-432f-afdc-b6eabcc064ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6818","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6819","nonce":653838958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6820","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6821","nonce":653838958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6824","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6825","nonce":653838958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6822","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6823","nonce":653838958}]},"public_addr":"10.20.193.47:6819/653838958","cluster_addr":"10.20.193.47:6821/653838958","heartbeat_back_addr":"10.20.193.47:6825/653838958","heartbeat_front_addr":"10.20.193.47:6823/653838958","state":["exists","up"]},{"osd":2,"uuid":"89bae13a-5285-484a-a28b-ede7f3252546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6802","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6803","nonce":2941176462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6804","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6805","nonce":2941176462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6808","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6809","nonce":2941176462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6806","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6807","nonce":2941176462}]},"public_addr":"10.20.193.47:6803/2941176462","cluster_addr":"10.20.193.47:6805/2941176462","heartbeat_back_addr":"10.20.193.47:6809/2941176462","heartbeat_front_addr":"10.20.193.47:6807/2941176462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.716264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.752673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.664493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T20:28:20.922 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-25T20:28:20.923 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-25T20:28:20.924 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-25T20:28:21.010 INFO:teuthology.orchestra.run.trial047.stdout:34359738373 2026-02-25T20:28:21.010 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T20:28:21.011 INFO:teuthology.orchestra.run.trial047.stdout:47244640263 2026-02-25T20:28:21.012 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T20:28:21.014 INFO:teuthology.orchestra.run.trial047.stdout:34359738372 2026-02-25T20:28:21.015 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T20:28:21.211 INFO:teuthology.orchestra.run.trial047.stdout:34359738372 2026-02-25T20:28:21.212 INFO:teuthology.orchestra.run.trial047.stdout:47244640262 2026-02-25T20:28:21.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2026-02-25T20:28:21.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640262 for osd.1 2026-02-25T20:28:21.262 INFO:teuthology.orchestra.run.trial047.stdout:34359738371 2026-02-25T20:28:21.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2026-02-25T20:28:22.224 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T20:28:22.225 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T20:28:22.275 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T20:28:22.378 INFO:teuthology.orchestra.run.trial047.stdout:47244640263 2026-02-25T20:28:22.383 INFO:teuthology.orchestra.run.trial047.stdout:34359738373 2026-02-25T20:28:22.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640263 for osd.1 2026-02-25T20:28:22.390 DEBUG:teuthology.parallel:result is None 2026-02-25T20:28:22.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2026-02-25T20:28:22.397 DEBUG:teuthology.parallel:result is None 2026-02-25T20:28:22.431 INFO:teuthology.orchestra.run.trial047.stdout:34359738372 2026-02-25T20:28:22.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2026-02-25T20:28:22.444 DEBUG:teuthology.parallel:result is None 2026-02-25T20:28:22.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T20:28:22.444 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T20:28:22.635 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:22.635 INFO:teuthology.orchestra.run.trial047.stderr:dumped all 2026-02-25T20:28:22.647 INFO:teuthology.orchestra.run.trial047.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-25T20:28:21.770483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82424,"kb_used_data":1544,"kb_used_omap":21,"kb_used_meta":80810,"kb_avail":314490376,"statfs":{"total":322122547200,"available":322038145024,"internally_reserved":0,"allocated":1581056,"data_stored":1289737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21775,"internal_metadata":82750193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198029+0000","last_change":"2026-02-25T20:28:20.198029+0000","last_active":"2026-02-25T20:28:20.198029+0000","last_peered":"2026-02-25T20:28:20.198029+0000","last_clean":"2026-02-25T20:28:20.198029+0000","last_became_active":"2026-02-25T20:28:18.195850+0000","last_became_peered":"2026-02-25T20:28:18.195850+0000","last_unstale":"2026-02-25T20:28:20.198029+0000","last_undegraded":"2026-02-25T20:28:20.198029+0000","last_fullsized":"2026-02-25T20:28:20.198029+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:08:22.756739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043050400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198199+0000","last_change":"2026-02-25T20:28:20.198199+0000","last_active":"2026-02-25T20:28:20.198199+0000","last_peered":"2026-02-25T20:28:20.198199+0000","last_clean":"2026-02-25T20:28:20.198199+0000","last_became_active":"2026-02-25T20:28:18.195879+0000","last_became_peered":"2026-02-25T20:28:18.195879+0000","last_unstale":"2026-02-25T20:28:20.198199+0000","last_undegraded":"2026-02-25T20:28:20.198199+0000","last_fullsized":"2026-02-25T20:28:20.198199+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:14:54.537699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053849200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198377+0000","last_change":"2026-02-25T20:28:20.198377+0000","last_active":"2026-02-25T20:28:20.198377+0000","last_peered":"2026-02-25T20:28:20.198377+0000","last_clean":"2026-02-25T20:28:20.198377+0000","last_became_active":"2026-02-25T20:28:18.195896+0000","last_became_peered":"2026-02-25T20:28:18.195896+0000","last_unstale":"2026-02-25T20:28:20.198377+0000","last_undegraded":"2026-02-25T20:28:20.198377+0000","last_fullsized":"2026-02-25T20:28:20.198377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:20.955416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065946600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198068+0000","last_change":"2026-02-25T20:28:20.198068+0000","last_active":"2026-02-25T20:28:20.198068+0000","last_peered":"2026-02-25T20:28:20.198068+0000","last_clean":"2026-02-25T20:28:20.198068+0000","last_became_active":"2026-02-25T20:28:18.195675+0000","last_became_peered":"2026-02-25T20:28:18.195675+0000","last_unstale":"2026-02-25T20:28:20.198068+0000","last_undegraded":"2026-02-25T20:28:20.198068+0000","last_fullsized":"2026-02-25T20:28:20.198068+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:38:33.920162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045795599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.196168+0000","last_change":"2026-02-25T20:28:20.196168+0000","last_active":"2026-02-25T20:28:20.196168+0000","last_peered":"2026-02-25T20:28:20.196168+0000","last_clean":"2026-02-25T20:28:20.196168+0000","last_became_active":"2026-02-25T20:28:18.195435+0000","last_became_peered":"2026-02-25T20:28:18.195435+0000","last_unstale":"2026-02-25T20:28:20.196168+0000","last_undegraded":"2026-02-25T20:28:20.196168+0000","last_fullsized":"2026-02-25T20:28:20.196168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:39:44.856036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028753600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.551083+0000","last_change":"2026-02-25T20:28:20.551205+0000","last_active":"2026-02-25T20:28:20.551083+0000","last_peered":"2026-02-25T20:28:20.551083+0000","last_clean":"2026-02-25T20:28:20.551083+0000","last_became_active":"2026-02-25T20:28:18.195942+0000","last_became_peered":"2026-02-25T20:28:18.195942+0000","last_unstale":"2026-02-25T20:28:20.551083+0000","last_undegraded":"2026-02-25T20:28:20.551083+0000","last_fullsized":"2026-02-25T20:28:20.551083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:56:19.382854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000349336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.551036+0000","last_change":"2026-02-25T20:28:20.551165+0000","last_active":"2026-02-25T20:28:20.551036+0000","last_peered":"2026-02-25T20:28:20.551036+0000","last_clean":"2026-02-25T20:28:20.551036+0000","last_became_active":"2026-02-25T20:28:18.195414+0000","last_became_peered":"2026-02-25T20:28:18.195414+0000","last_unstale":"2026-02-25T20:28:20.551036+0000","last_undegraded":"2026-02-25T20:28:20.551036+0000","last_fullsized":"2026-02-25T20:28:20.551036+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:13:02.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032044000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198236+0000","last_change":"2026-02-25T20:28:20.198236+0000","last_active":"2026-02-25T20:28:20.198236+0000","last_peered":"2026-02-25T20:28:20.198236+0000","last_clean":"2026-02-25T20:28:20.198236+0000","last_became_active":"2026-02-25T20:28:18.194940+0000","last_became_peered":"2026-02-25T20:28:18.194940+0000","last_unstale":"2026-02-25T20:28:20.198236+0000","last_undegraded":"2026-02-25T20:28:20.198236+0000","last_fullsized":"2026-02-25T20:28:20.198236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:25:43.293805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053638799999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'72","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.197515+0000","last_change":"2026-02-25T20:28:18.200227+0000","last_active":"2026-02-25T20:28:20.197515+0000","last_peered":"2026-02-25T20:28:20.197515+0000","last_clean":"2026-02-25T20:28:20.197515+0000","last_became_active":"2026-02-25T20:28:18.194757+0000","last_became_peered":"2026-02-25T20:28:18.194757+0000","last_unstale":"2026-02-25T20:28:20.197515+0000","last_undegraded":"2026-02-25T20:28:20.197515+0000","last_fullsized":"2026-02-25T20:28:20.197515+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_clean_scrub_stamp":"2026-02-25T20:28:14.088080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:11:10.120605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27672,"kb_used_data":712,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104829928,"statfs":{"total":107374182400,"available":107345846272,"internally_reserved":0,"allocated":729088,"data_stored":627896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":120,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":122880,"data_stored":33945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27672,"kb_used_data":712,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":104829928,"statfs":{"total":107374182400,"available":107345846272,"internally_reserved":0,"allocated":729088,"data_stored":627896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T20:28:22.648 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T20:28:22.801 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:22.802 INFO:teuthology.orchestra.run.trial047.stderr:dumped all 2026-02-25T20:28:22.813 INFO:teuthology.orchestra.run.trial047.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-25T20:28:21.770483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82424,"kb_used_data":1544,"kb_used_omap":21,"kb_used_meta":80810,"kb_avail":314490376,"statfs":{"total":322122547200,"available":322038145024,"internally_reserved":0,"allocated":1581056,"data_stored":1289737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21775,"internal_metadata":82750193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198029+0000","last_change":"2026-02-25T20:28:20.198029+0000","last_active":"2026-02-25T20:28:20.198029+0000","last_peered":"2026-02-25T20:28:20.198029+0000","last_clean":"2026-02-25T20:28:20.198029+0000","last_became_active":"2026-02-25T20:28:18.195850+0000","last_became_peered":"2026-02-25T20:28:18.195850+0000","last_unstale":"2026-02-25T20:28:20.198029+0000","last_undegraded":"2026-02-25T20:28:20.198029+0000","last_fullsized":"2026-02-25T20:28:20.198029+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:08:22.756739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043050400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198199+0000","last_change":"2026-02-25T20:28:20.198199+0000","last_active":"2026-02-25T20:28:20.198199+0000","last_peered":"2026-02-25T20:28:20.198199+0000","last_clean":"2026-02-25T20:28:20.198199+0000","last_became_active":"2026-02-25T20:28:18.195879+0000","last_became_peered":"2026-02-25T20:28:18.195879+0000","last_unstale":"2026-02-25T20:28:20.198199+0000","last_undegraded":"2026-02-25T20:28:20.198199+0000","last_fullsized":"2026-02-25T20:28:20.198199+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:14:54.537699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053849200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198377+0000","last_change":"2026-02-25T20:28:20.198377+0000","last_active":"2026-02-25T20:28:20.198377+0000","last_peered":"2026-02-25T20:28:20.198377+0000","last_clean":"2026-02-25T20:28:20.198377+0000","last_became_active":"2026-02-25T20:28:18.195896+0000","last_became_peered":"2026-02-25T20:28:18.195896+0000","last_unstale":"2026-02-25T20:28:20.198377+0000","last_undegraded":"2026-02-25T20:28:20.198377+0000","last_fullsized":"2026-02-25T20:28:20.198377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:20.955416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065946600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198068+0000","last_change":"2026-02-25T20:28:20.198068+0000","last_active":"2026-02-25T20:28:20.198068+0000","last_peered":"2026-02-25T20:28:20.198068+0000","last_clean":"2026-02-25T20:28:20.198068+0000","last_became_active":"2026-02-25T20:28:18.195675+0000","last_became_peered":"2026-02-25T20:28:18.195675+0000","last_unstale":"2026-02-25T20:28:20.198068+0000","last_undegraded":"2026-02-25T20:28:20.198068+0000","last_fullsized":"2026-02-25T20:28:20.198068+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:38:33.920162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045795599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.196168+0000","last_change":"2026-02-25T20:28:20.196168+0000","last_active":"2026-02-25T20:28:20.196168+0000","last_peered":"2026-02-25T20:28:20.196168+0000","last_clean":"2026-02-25T20:28:20.196168+0000","last_became_active":"2026-02-25T20:28:18.195435+0000","last_became_peered":"2026-02-25T20:28:18.195435+0000","last_unstale":"2026-02-25T20:28:20.196168+0000","last_undegraded":"2026-02-25T20:28:20.196168+0000","last_fullsized":"2026-02-25T20:28:20.196168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:39:44.856036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028753600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.551083+0000","last_change":"2026-02-25T20:28:20.551205+0000","last_active":"2026-02-25T20:28:20.551083+0000","last_peered":"2026-02-25T20:28:20.551083+0000","last_clean":"2026-02-25T20:28:20.551083+0000","last_became_active":"2026-02-25T20:28:18.195942+0000","last_became_peered":"2026-02-25T20:28:18.195942+0000","last_unstale":"2026-02-25T20:28:20.551083+0000","last_undegraded":"2026-02-25T20:28:20.551083+0000","last_fullsized":"2026-02-25T20:28:20.551083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:56:19.382854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000349336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.551036+0000","last_change":"2026-02-25T20:28:20.551165+0000","last_active":"2026-02-25T20:28:20.551036+0000","last_peered":"2026-02-25T20:28:20.551036+0000","last_clean":"2026-02-25T20:28:20.551036+0000","last_became_active":"2026-02-25T20:28:18.195414+0000","last_became_peered":"2026-02-25T20:28:18.195414+0000","last_unstale":"2026-02-25T20:28:20.551036+0000","last_undegraded":"2026-02-25T20:28:20.551036+0000","last_fullsized":"2026-02-25T20:28:20.551036+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:13:02.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032044000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.198236+0000","last_change":"2026-02-25T20:28:20.198236+0000","last_active":"2026-02-25T20:28:20.198236+0000","last_peered":"2026-02-25T20:28:20.198236+0000","last_clean":"2026-02-25T20:28:20.198236+0000","last_became_active":"2026-02-25T20:28:18.194940+0000","last_became_peered":"2026-02-25T20:28:18.194940+0000","last_unstale":"2026-02-25T20:28:20.198236+0000","last_undegraded":"2026-02-25T20:28:20.198236+0000","last_fullsized":"2026-02-25T20:28:20.198236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:25:43.293805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053638799999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'72","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T20:28:20.197515+0000","last_change":"2026-02-25T20:28:18.200227+0000","last_active":"2026-02-25T20:28:20.197515+0000","last_peered":"2026-02-25T20:28:20.197515+0000","last_clean":"2026-02-25T20:28:20.197515+0000","last_became_active":"2026-02-25T20:28:18.194757+0000","last_became_peered":"2026-02-25T20:28:18.194757+0000","last_unstale":"2026-02-25T20:28:20.197515+0000","last_undegraded":"2026-02-25T20:28:20.197515+0000","last_fullsized":"2026-02-25T20:28:20.197515+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_clean_scrub_stamp":"2026-02-25T20:28:14.088080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:11:10.120605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27672,"kb_used_data":712,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104829928,"statfs":{"total":107374182400,"available":107345846272,"internally_reserved":0,"allocated":729088,"data_stored":627896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":120,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":122880,"data_stored":33945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27672,"kb_used_data":712,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":104829928,"statfs":{"total":107374182400,"available":107345846272,"internally_reserved":0,"allocated":729088,"data_stored":627896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T20:28:22.815 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T20:28:22.815 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-25T20:28:22.815 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-25T20:28:22.815 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-25T20:28:22.990 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:22.990 INFO:teuthology.orchestra.run.trial047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-25T20:28:23.000 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-25T20:28:23.001 INFO:teuthology.run_tasks:Running task tox... 2026-02-25T20:28:23.018 INFO:tasks.tox:Deploying tox from pip... 2026-02-25T20:28:23.018 DEBUG:teuthology.orchestra.run.trial047:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2026-02-25T20:28:24.337 DEBUG:teuthology.orchestra.run.trial047:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox 2026-02-25T20:28:24.626 INFO:teuthology.orchestra.run.trial047.stdout:Collecting tox 2026-02-25T20:28:24.655 INFO:teuthology.orchestra.run.trial047.stdout: Downloading tox-4.46.3-py3-none-any.whl (201 kB) 2026-02-25T20:28:24.670 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 201.4/201.4 KB 14.2 MB/s eta 0:00:00 2026-02-25T20:28:24.687 INFO:teuthology.orchestra.run.trial047.stdout:Collecting pyproject-api>=1.10 2026-02-25T20:28:24.691 INFO:teuthology.orchestra.run.trial047.stdout: Downloading pyproject_api-1.10.0-py3-none-any.whl (13 kB) 2026-02-25T20:28:24.706 INFO:teuthology.orchestra.run.trial047.stdout:Collecting pluggy>=1.6 2026-02-25T20:28:24.711 INFO:teuthology.orchestra.run.trial047.stdout: Downloading pluggy-1.6.0-py3-none-any.whl (20 kB) 2026-02-25T20:28:24.730 INFO:teuthology.orchestra.run.trial047.stdout:Collecting platformdirs>=4.9.2 2026-02-25T20:28:24.735 INFO:teuthology.orchestra.run.trial047.stdout: Downloading platformdirs-4.9.2-py3-none-any.whl (21 kB) 2026-02-25T20:28:24.788 INFO:teuthology.orchestra.run.trial047.stdout:Collecting virtualenv>=20.39 2026-02-25T20:28:24.799 INFO:teuthology.orchestra.run.trial047.stdout: Downloading virtualenv-21.0.0-py3-none-any.whl (5.8 MB) 2026-02-25T20:28:24.932 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.8/5.8 MB 44.0 MB/s eta 0:00:00 2026-02-25T20:28:24.954 INFO:teuthology.orchestra.run.trial047.stdout:Collecting packaging>=26 2026-02-25T20:28:24.960 INFO:teuthology.orchestra.run.trial047.stdout: Downloading packaging-26.0-py3-none-any.whl (74 kB) 2026-02-25T20:28:24.962 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74.4/74.4 KB 77.0 MB/s eta 0:00:00 2026-02-25T20:28:24.982 INFO:teuthology.orchestra.run.trial047.stdout:Collecting tomli>=2.4 2026-02-25T20:28:24.986 INFO:teuthology.orchestra.run.trial047.stdout: Downloading tomli-2.4.0-py3-none-any.whl (14 kB) 2026-02-25T20:28:25.003 INFO:teuthology.orchestra.run.trial047.stdout:Collecting cachetools>=7.0.1 2026-02-25T20:28:25.008 INFO:teuthology.orchestra.run.trial047.stdout: Downloading cachetools-7.0.1-py3-none-any.whl (13 kB) 2026-02-25T20:28:25.028 INFO:teuthology.orchestra.run.trial047.stdout:Collecting filelock>=3.24.3 2026-02-25T20:28:25.035 INFO:teuthology.orchestra.run.trial047.stdout: Downloading filelock-3.24.3-py3-none-any.whl (24 kB) 2026-02-25T20:28:25.054 INFO:teuthology.orchestra.run.trial047.stdout:Collecting colorama>=0.4.6 2026-02-25T20:28:25.059 INFO:teuthology.orchestra.run.trial047.stdout: Downloading colorama-0.4.6-py2.py3-none-any.whl (25 kB) 2026-02-25T20:28:25.076 INFO:teuthology.orchestra.run.trial047.stdout:Collecting typing-extensions>=4.15 2026-02-25T20:28:25.080 INFO:teuthology.orchestra.run.trial047.stdout: Downloading typing_extensions-4.15.0-py3-none-any.whl (44 kB) 2026-02-25T20:28:25.082 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.6/44.6 KB 48.6 MB/s eta 0:00:00 2026-02-25T20:28:25.106 INFO:teuthology.orchestra.run.trial047.stdout:Collecting python-discovery>=1 2026-02-25T20:28:25.112 INFO:teuthology.orchestra.run.trial047.stdout: Downloading python_discovery-1.0.0-py3-none-any.whl (28 kB) 2026-02-25T20:28:25.123 INFO:teuthology.orchestra.run.trial047.stdout:Collecting distlib<1,>=0.3.7 2026-02-25T20:28:25.127 INFO:teuthology.orchestra.run.trial047.stdout: Downloading distlib-0.4.0-py2.py3-none-any.whl (469 kB) 2026-02-25T20:28:25.132 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 469.0/469.0 KB 106.6 MB/s eta 0:00:00 2026-02-25T20:28:25.178 INFO:teuthology.orchestra.run.trial047.stdout:Installing collected packages: distlib, typing-extensions, tomli, pluggy, platformdirs, packaging, filelock, colorama, cachetools, python-discovery, pyproject-api, virtualenv, tox 2026-02-25T20:28:25.403 INFO:teuthology.orchestra.run.trial047.stdout:Successfully installed cachetools-7.0.1 colorama-0.4.6 distlib-0.4.0 filelock-3.24.3 packaging-26.0 platformdirs-4.9.2 pluggy-1.6.0 pyproject-api-1.10.0 python-discovery-1.0.0 tomli-2.4.0 tox-4.46.3 typing-extensions-4.15.0 virtualenv-21.0.0 2026-02-25T20:28:25.439 INFO:teuthology.run_tasks:Running task keystone... 2026-02-25T20:28:25.462 DEBUG:tasks.keystone:Keystone config is {'client.0': {'force-branch': 'stable/2024.2', 'services': [{'description': 'Swift Service', 'name': 'swift', 'type': 'object-store'}], 'ec2 credentials': [{'project': 's3tests', 'user': 's3tests-main'}], 'projects': [{'description': 's3tests project', 'name': 's3tests'}], 'role-mappings': [{'name': 'member', 'project': 's3tests', 'user': 's3tests-main'}], 'roles': [{'name': 'member'}], 'users': [{'name': 's3tests-main', 'password': 'SECRET', 'project': 's3tests'}]}} 2026-02-25T20:28:25.463 INFO:tasks.keystone:Downloading keystone... 2026-02-25T20:28:25.463 DEBUG:teuthology.orchestra.run.trial047:> git clone -b stable/2024.2 https://github.com/openstack/keystone.git /home/ubuntu/cephtest/keystone 2026-02-25T20:28:25.473 INFO:teuthology.orchestra.run.trial047.stderr:Cloning into '/home/ubuntu/cephtest/keystone'... 2026-02-25T20:28:27.351 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && sed -i 's/pysaml2<4.0.3,>=2.4.0/pysaml2>=4.5.0/' requirements.txt 2026-02-25T20:28:27.396 INFO:tasks.keystone:Installing packages for Keystone... 2026-02-25T20:28:27.397 DEBUG:teuthology.orchestra.run.trial047:> source /home/ubuntu/cephtest/tox-venv/bin/activate && python 2026-02-25T20:28:27.485 INFO:teuthology.orchestra.run.trial047.stderr:No fix necessary 2026-02-25T20:28:27.487 DEBUG:teuthology.orchestra.run.trial047:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install bindep 2026-02-25T20:28:27.746 INFO:teuthology.orchestra.run.trial047.stdout:Collecting bindep 2026-02-25T20:28:27.775 INFO:teuthology.orchestra.run.trial047.stdout: Downloading bindep-2.13.0-py3-none-any.whl (34 kB) 2026-02-25T20:28:27.788 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: packaging in ./cephtest/tox-venv/lib/python3.10/site-packages (from bindep) (26.0) 2026-02-25T20:28:27.797 INFO:teuthology.orchestra.run.trial047.stdout:Collecting Parsley 2026-02-25T20:28:27.804 INFO:teuthology.orchestra.run.trial047.stdout: Downloading Parsley-1.3-py2.py3-none-any.whl (88 kB) 2026-02-25T20:28:27.810 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.9/88.9 KB 16.9 MB/s eta 0:00:00 2026-02-25T20:28:27.820 INFO:teuthology.orchestra.run.trial047.stdout:Collecting distro>=1.7 2026-02-25T20:28:27.824 INFO:teuthology.orchestra.run.trial047.stdout: Downloading distro-1.9.0-py3-none-any.whl (20 kB) 2026-02-25T20:28:27.847 INFO:teuthology.orchestra.run.trial047.stdout:Collecting pbr>=2 2026-02-25T20:28:27.852 INFO:teuthology.orchestra.run.trial047.stdout: Downloading pbr-7.0.3-py2.py3-none-any.whl (131 kB) 2026-02-25T20:28:27.858 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 131.9/131.9 KB 22.4 MB/s eta 0:00:00 2026-02-25T20:28:27.860 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: setuptools in ./cephtest/tox-venv/lib/python3.10/site-packages (from pbr>=2->bindep) (59.6.0) 2026-02-25T20:28:27.885 INFO:teuthology.orchestra.run.trial047.stdout:Installing collected packages: Parsley, pbr, distro, bindep 2026-02-25T20:28:27.970 INFO:teuthology.orchestra.run.trial047.stdout:Successfully installed Parsley-1.3 bindep-2.13.0 distro-1.9.0 pbr-7.0.3 2026-02-25T20:28:27.999 DEBUG:teuthology.orchestra.run.trial047:> source /home/ubuntu/cephtest/tox-venv/bin/activate && bindep --brief --file /home/ubuntu/cephtest/keystone/bindep.txt 2026-02-25T20:28:28.347 INFO:teuthology.orchestra.run.trial047.stdout:libffi-dev 2026-02-25T20:28:28.347 INFO:teuthology.orchestra.run.trial047.stdout:libldap2-dev 2026-02-25T20:28:28.347 INFO:teuthology.orchestra.run.trial047.stdout:libsasl2-dev 2026-02-25T20:28:28.347 INFO:teuthology.orchestra.run.trial047.stdout:libsqlite3-dev 2026-02-25T20:28:28.347 INFO:teuthology.orchestra.run.trial047.stdout:libssl-dev 2026-02-25T20:28:28.348 INFO:teuthology.orchestra.run.trial047.stdout:libxml2-dev 2026-02-25T20:28:28.348 INFO:teuthology.orchestra.run.trial047.stdout:libxslt1-dev 2026-02-25T20:28:28.348 INFO:teuthology.orchestra.run.trial047.stdout:mysql-client 2026-02-25T20:28:28.348 INFO:teuthology.orchestra.run.trial047.stdout:mysql-server 2026-02-25T20:28:28.348 INFO:teuthology.orchestra.run.trial047.stdout:postgresql 2026-02-25T20:28:28.348 INFO:teuthology.orchestra.run.trial047.stdout:postgresql-client 2026-02-25T20:28:28.348 INFO:teuthology.orchestra.run.trial047.stdout:postgresql-server-dev-all 2026-02-25T20:28:28.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T20:28:28.372 INFO:teuthology.packaging:Installing package libffi-dev on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:28.372 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install libffi-dev 2026-02-25T20:28:28.407 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:28.518 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:28.519 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:28.607 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:28.607 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:28.607 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:28.607 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:28.607 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:28.607 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:28.607 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:28.618 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:28.619 INFO:teuthology.orchestra.run.trial047.stdout: libffi-dev 2026-02-25T20:28:29.128 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 1 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:29.128 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 63.7 kB of archives. 2026-02-25T20:28:29.128 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 336 kB of additional disk space will be used. 2026-02-25T20:28:29.128 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 libffi-dev amd64 3.4.2-4 [63.7 kB] 2026-02-25T20:28:29.511 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 63.7 kB in 1s (90.4 kB/s) 2026-02-25T20:28:29.527 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libffi-dev:amd64. 2026-02-25T20:28:29.569 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 210850 files and directories currently installed.) 2026-02-25T20:28:29.572 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libffi-dev_3.4.2-4_amd64.deb ... 2026-02-25T20:28:29.572 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libffi-dev:amd64 (3.4.2-4) ... 2026-02-25T20:28:29.603 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libffi-dev:amd64 (3.4.2-4) ... 2026-02-25T20:28:29.604 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-25T20:28:29.675 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:28:30.353 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:30.353 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:30.353 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:30.354 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:31.184 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:31.187 INFO:teuthology.packaging:Installing package libldap2-dev on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:31.187 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install libldap2-dev 2026-02-25T20:28:31.264 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:31.373 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:31.373 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:31.458 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:31.458 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:31.458 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:31.458 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:31.458 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:31.459 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:31.459 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:31.459 INFO:teuthology.orchestra.run.trial047.stdout:The following additional packages will be installed: 2026-02-25T20:28:31.459 INFO:teuthology.orchestra.run.trial047.stdout: libldap-dev 2026-02-25T20:28:31.468 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:31.469 INFO:teuthology.orchestra.run.trial047.stdout: libldap-dev libldap2-dev 2026-02-25T20:28:31.564 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 2 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:31.564 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 310 kB of archives. 2026-02-25T20:28:31.564 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 1703 kB of additional disk space will be used. 2026-02-25T20:28:31.564 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libldap-dev amd64 2.5.20+dfsg-0ubuntu0.22.04.1 [303 kB] 2026-02-25T20:28:31.616 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libldap2-dev all 2.5.20+dfsg-0ubuntu0.22.04.1 [7108 B] 2026-02-25T20:28:31.795 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 310 kB in 0s (2146 kB/s) 2026-02-25T20:28:31.809 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libldap-dev:amd64. 2026-02-25T20:28:31.852 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 210885 files and directories currently installed.) 2026-02-25T20:28:31.854 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libldap-dev_2.5.20+dfsg-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:28:31.855 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libldap-dev:amd64 (2.5.20+dfsg-0ubuntu0.22.04.1) ... 2026-02-25T20:28:31.888 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libldap2-dev. 2026-02-25T20:28:31.899 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libldap2-dev_2.5.20+dfsg-0ubuntu0.22.04.1_all.deb ... 2026-02-25T20:28:31.899 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libldap2-dev (2.5.20+dfsg-0ubuntu0.22.04.1) ... 2026-02-25T20:28:31.924 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libldap-dev:amd64 (2.5.20+dfsg-0ubuntu0.22.04.1) ... 2026-02-25T20:28:31.925 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libldap2-dev (2.5.20+dfsg-0ubuntu0.22.04.1) ... 2026-02-25T20:28:31.926 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:28:32.589 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:32.589 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:32.590 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:33.411 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:33.414 INFO:teuthology.packaging:Installing package libsasl2-dev on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:33.414 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install libsasl2-dev 2026-02-25T20:28:33.488 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:33.602 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:33.602 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:33.690 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:33.691 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:33.691 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:33.691 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:33.691 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:33.691 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:33.691 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:33.702 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:33.702 INFO:teuthology.orchestra.run.trial047.stdout: libsasl2-dev 2026-02-25T20:28:34.305 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 1 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:34.305 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 248 kB of archives. 2026-02-25T20:28:34.305 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 916 kB of additional disk space will be used. 2026-02-25T20:28:34.306 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsasl2-dev amd64 2.1.27+dfsg2-3ubuntu1.2 [248 kB] 2026-02-25T20:28:34.778 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 248 kB in 1s (278 kB/s) 2026-02-25T20:28:34.793 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libsasl2-dev. 2026-02-25T20:28:34.834 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 211103 files and directories currently installed.) 2026-02-25T20:28:34.837 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libsasl2-dev_2.1.27+dfsg2-3ubuntu1.2_amd64.deb ... 2026-02-25T20:28:34.837 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libsasl2-dev (2.1.27+dfsg2-3ubuntu1.2) ... 2026-02-25T20:28:34.869 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libsasl2-dev (2.1.27+dfsg2-3ubuntu1.2) ... 2026-02-25T20:28:34.870 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:28:35.513 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:35.513 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:35.513 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:35.513 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:35.513 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:35.514 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:35.514 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:35.514 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:35.514 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:35.514 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:35.514 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:35.514 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:36.337 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:36.341 INFO:teuthology.packaging:Installing package libsqlite3-dev on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:36.341 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install libsqlite3-dev 2026-02-25T20:28:36.417 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:36.526 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:36.526 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout:Suggested packages: 2026-02-25T20:28:36.613 INFO:teuthology.orchestra.run.trial047.stdout: sqlite3-doc 2026-02-25T20:28:36.624 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:36.624 INFO:teuthology.orchestra.run.trial047.stdout: libsqlite3-dev 2026-02-25T20:28:36.969 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 1 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:36.970 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 847 kB of archives. 2026-02-25T20:28:36.970 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 3167 kB of additional disk space will be used. 2026-02-25T20:28:36.970 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-dev amd64 3.37.2-2ubuntu0.5 [847 kB] 2026-02-25T20:28:37.569 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 847 kB in 1s (1111 kB/s) 2026-02-25T20:28:37.586 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libsqlite3-dev:amd64. 2026-02-25T20:28:37.633 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 211170 files and directories currently installed.) 2026-02-25T20:28:37.636 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libsqlite3-dev_3.37.2-2ubuntu0.5_amd64.deb ... 2026-02-25T20:28:37.636 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libsqlite3-dev:amd64 (3.37.2-2ubuntu0.5) ... 2026-02-25T20:28:37.668 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libsqlite3-dev:amd64 (3.37.2-2ubuntu0.5) ... 2026-02-25T20:28:38.261 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:38.261 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:38.261 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:38.261 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:38.261 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:38.261 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:38.262 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:38.262 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:38.262 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:38.262 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:38.262 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:38.262 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:39.085 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:39.088 INFO:teuthology.packaging:Installing package libssl-dev on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:39.088 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install libssl-dev 2026-02-25T20:28:39.165 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:39.276 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:39.277 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout:Suggested packages: 2026-02-25T20:28:39.366 INFO:teuthology.orchestra.run.trial047.stdout: libssl-doc 2026-02-25T20:28:39.378 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:39.378 INFO:teuthology.orchestra.run.trial047.stdout: libssl-dev 2026-02-25T20:28:39.725 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 1 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:39.725 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 2375 kB of archives. 2026-02-25T20:28:39.725 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 12.4 MB of additional disk space will be used. 2026-02-25T20:28:39.725 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.21 [2375 kB] 2026-02-25T20:28:39.787 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:28:39.787 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:28:39.790 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:28:39.790 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:28:39.791 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:28:39.791 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:28:40.439 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 2375 kB in 1s (2713 kB/s) 2026-02-25T20:28:40.453 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libssl-dev:amd64. 2026-02-25T20:28:40.492 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 211178 files and directories currently installed.) 2026-02-25T20:28:40.495 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libssl-dev_3.0.2-0ubuntu1.21_amd64.deb ... 2026-02-25T20:28:40.495 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-25T20:28:40.555 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-25T20:28:41.153 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:41.153 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:41.153 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:41.153 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:41.153 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:41.153 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:41.153 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:41.154 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:41.154 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:41.154 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:41.154 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:41.154 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:41.943 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:41.946 INFO:teuthology.packaging:Installing package libxml2-dev on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:41.947 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install libxml2-dev 2026-02-25T20:28:42.020 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:42.129 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:42.129 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:42.214 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:42.214 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:42.214 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:42.214 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:42.214 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:42.215 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:42.215 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:42.215 INFO:teuthology.orchestra.run.trial047.stdout:The following additional packages will be installed: 2026-02-25T20:28:42.215 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools libicu-dev 2026-02-25T20:28:42.215 INFO:teuthology.orchestra.run.trial047.stdout:Suggested packages: 2026-02-25T20:28:42.215 INFO:teuthology.orchestra.run.trial047.stdout: icu-doc pkg-config 2026-02-25T20:28:42.226 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:42.226 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools libicu-dev libxml2-dev 2026-02-25T20:28:42.321 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 3 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:42.321 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 12.6 MB of archives. 2026-02-25T20:28:42.322 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 51.2 MB of additional disk space will be used. 2026-02-25T20:28:42.322 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 icu-devtools amd64 70.1-2 [197 kB] 2026-02-25T20:28:42.367 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 libicu-dev amd64 70.1-2 [11.6 MB] 2026-02-25T20:28:42.453 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxml2-dev amd64 2.9.13+dfsg-1ubuntu0.11 [805 kB] 2026-02-25T20:28:42.639 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 12.6 MB in 0s (55.5 MB/s) 2026-02-25T20:28:42.651 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package icu-devtools. 2026-02-25T20:28:42.693 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 211326 files and directories currently installed.) 2026-02-25T20:28:42.695 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../icu-devtools_70.1-2_amd64.deb ... 2026-02-25T20:28:42.696 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking icu-devtools (70.1-2) ... 2026-02-25T20:28:42.716 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libicu-dev:amd64. 2026-02-25T20:28:42.727 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libicu-dev_70.1-2_amd64.deb ... 2026-02-25T20:28:42.728 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libicu-dev:amd64 (70.1-2) ... 2026-02-25T20:28:42.846 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libxml2-dev:amd64. 2026-02-25T20:28:42.857 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libxml2-dev_2.9.13+dfsg-1ubuntu0.11_amd64.deb ... 2026-02-25T20:28:42.857 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libxml2-dev:amd64 (2.9.13+dfsg-1ubuntu0.11) ... 2026-02-25T20:28:42.897 INFO:teuthology.orchestra.run.trial047.stdout:Setting up icu-devtools (70.1-2) ... 2026-02-25T20:28:42.898 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libicu-dev:amd64 (70.1-2) ... 2026-02-25T20:28:42.899 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libxml2-dev:amd64 (2.9.13+dfsg-1ubuntu0.11) ... 2026-02-25T20:28:42.900 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:28:43.564 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:43.564 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:43.565 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:44.407 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:44.410 INFO:teuthology.packaging:Installing package libxslt1-dev on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:44.411 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install libxslt1-dev 2026-02-25T20:28:44.484 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:44.595 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:44.596 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:44.685 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:44.685 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:44.685 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:44.685 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:44.685 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:44.686 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:44.686 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:44.696 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:44.696 INFO:teuthology.orchestra.run.trial047.stdout: libxslt1-dev 2026-02-25T20:28:45.043 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 1 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:45.043 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 219 kB of archives. 2026-02-25T20:28:45.043 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 2059 kB of additional disk space will be used. 2026-02-25T20:28:45.043 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxslt1-dev amd64 1.1.34-4ubuntu0.22.04.5 [219 kB] 2026-02-25T20:28:45.501 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 219 kB in 1s (353 kB/s) 2026-02-25T20:28:45.517 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libxslt1-dev:amd64. 2026-02-25T20:28:45.560 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 211641 files and directories currently installed.) 2026-02-25T20:28:45.563 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libxslt1-dev_1.1.34-4ubuntu0.22.04.5_amd64.deb ... 2026-02-25T20:28:45.563 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libxslt1-dev:amd64 (1.1.34-4ubuntu0.22.04.5) ... 2026-02-25T20:28:45.604 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libxslt1-dev:amd64 (1.1.34-4ubuntu0.22.04.5) ... 2026-02-25T20:28:45.605 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:28:46.268 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:46.268 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:46.269 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:47.099 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:47.102 INFO:teuthology.packaging:Installing package mysql-client on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:47.102 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install mysql-client 2026-02-25T20:28:47.177 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:47.291 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:47.292 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:47.380 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:47.380 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:47.380 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:47.380 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:47.380 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:47.380 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:47.381 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:47.381 INFO:teuthology.orchestra.run.trial047.stdout:The following additional packages will be installed: 2026-02-25T20:28:47.381 INFO:teuthology.orchestra.run.trial047.stdout: mysql-client-8.0 mysql-client-core-8.0 mysql-common 2026-02-25T20:28:47.392 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:47.392 INFO:teuthology.orchestra.run.trial047.stdout: mysql-client mysql-client-8.0 mysql-client-core-8.0 mysql-common 2026-02-25T20:28:47.737 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 4 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:47.738 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 2746 kB of archives. 2026-02-25T20:28:47.738 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 62.2 MB of additional disk space will be used. 2026-02-25T20:28:47.738 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-client-core-8.0 amd64 8.0.45-0ubuntu0.22.04.1 [2707 kB] 2026-02-25T20:28:48.350 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 mysql-common all 5.8+1.0.8 [7212 B] 2026-02-25T20:28:48.351 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-client-8.0 amd64 8.0.45-0ubuntu0.22.04.1 [22.7 kB] 2026-02-25T20:28:48.351 INFO:teuthology.orchestra.run.trial047.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-client all 8.0.45-0ubuntu0.22.04.1 [9352 B] 2026-02-25T20:28:48.534 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 2746 kB in 1s (2871 kB/s) 2026-02-25T20:28:48.550 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mysql-client-core-8.0. 2026-02-25T20:28:48.594 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 211782 files and directories currently installed.) 2026-02-25T20:28:48.597 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../mysql-client-core-8.0_8.0.45-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:28:48.598 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mysql-client-core-8.0 (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:48.727 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mysql-common. 2026-02-25T20:28:48.736 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../mysql-common_5.8+1.0.8_all.deb ... 2026-02-25T20:28:48.745 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mysql-common (5.8+1.0.8) ... 2026-02-25T20:28:48.762 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mysql-client-8.0. 2026-02-25T20:28:48.772 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../mysql-client-8.0_8.0.45-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:28:48.773 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mysql-client-8.0 (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:48.790 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mysql-client. 2026-02-25T20:28:48.801 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../mysql-client_8.0.45-0ubuntu0.22.04.1_all.deb ... 2026-02-25T20:28:48.801 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mysql-client (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:48.828 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mysql-common (5.8+1.0.8) ... 2026-02-25T20:28:48.838 INFO:teuthology.orchestra.run.trial047.stdout:update-alternatives: using /etc/mysql/my.cnf.fallback to provide /etc/mysql/my.cnf (my.cnf) in auto mode 2026-02-25T20:28:48.839 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mysql-client-core-8.0 (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:48.840 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mysql-client-8.0 (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:48.840 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mysql-client (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:48.841 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:28:49.496 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:49.496 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:28:49.496 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:28:49.497 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:28:50.355 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:28:50.358 INFO:teuthology.packaging:Installing package mysql-server on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:28:50.359 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install mysql-server 2026-02-25T20:28:50.441 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:28:50.554 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:28:50.554 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:28:50.643 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:28:50.643 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:28:50.643 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout:The following additional packages will be installed: 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout: libcgi-fast-perl libcgi-pm-perl libfcgi-perl libhtml-template-perl libmecab2 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout: libprotobuf-lite23 mecab-ipadic mecab-ipadic-utf8 mecab-utils 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout: mysql-server-8.0 mysql-server-core-8.0 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout:Suggested packages: 2026-02-25T20:28:50.644 INFO:teuthology.orchestra.run.trial047.stdout: libipc-sharedcache-perl mailx tinyca 2026-02-25T20:28:50.656 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:28:50.656 INFO:teuthology.orchestra.run.trial047.stdout: libcgi-fast-perl libcgi-pm-perl libfcgi-perl libhtml-template-perl libmecab2 2026-02-25T20:28:50.657 INFO:teuthology.orchestra.run.trial047.stdout: libprotobuf-lite23 mecab-ipadic mecab-ipadic-utf8 mecab-utils mysql-server 2026-02-25T20:28:50.657 INFO:teuthology.orchestra.run.trial047.stdout: mysql-server-8.0 mysql-server-core-8.0 2026-02-25T20:28:51.079 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 12 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:28:51.079 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 26.7 MB of archives. 2026-02-25T20:28:51.079 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 180 MB of additional disk space will be used. 2026-02-25T20:28:51.079 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 libmecab2 amd64 0.996-14build9 [199 kB] 2026-02-25T20:28:51.512 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libprotobuf-lite23 amd64 3.12.4-1ubuntu7.22.04.6 [209 kB] 2026-02-25T20:28:51.581 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-server-core-8.0 amd64 8.0.45-0ubuntu0.22.04.1 [17.8 MB] 2026-02-25T20:28:52.354 INFO:teuthology.orchestra.run.trial047.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-server-8.0 amd64 8.0.45-0ubuntu0.22.04.1 [1448 kB] 2026-02-25T20:28:52.395 INFO:teuthology.orchestra.run.trial047.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy/main amd64 libcgi-pm-perl all 4.54-1 [188 kB] 2026-02-25T20:28:52.403 INFO:teuthology.orchestra.run.trial047.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy/main amd64 libfcgi-perl amd64 0.82+ds-1build1 [22.8 kB] 2026-02-25T20:28:52.404 INFO:teuthology.orchestra.run.trial047.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy/main amd64 libcgi-fast-perl all 1:2.15-1 [10.5 kB] 2026-02-25T20:28:52.404 INFO:teuthology.orchestra.run.trial047.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/main amd64 libhtml-template-perl all 2.97-1.1 [59.1 kB] 2026-02-25T20:28:52.406 INFO:teuthology.orchestra.run.trial047.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/main amd64 mecab-utils amd64 0.996-14build9 [4850 B] 2026-02-25T20:28:52.406 INFO:teuthology.orchestra.run.trial047.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 mecab-ipadic all 2.7.0-20070801+main-3 [6718 kB] 2026-02-25T20:28:52.606 INFO:teuthology.orchestra.run.trial047.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 mecab-ipadic-utf8 all 2.7.0-20070801+main-3 [4384 B] 2026-02-25T20:28:52.606 INFO:teuthology.orchestra.run.trial047.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-server all 8.0.45-0ubuntu0.22.04.1 [9462 B] 2026-02-25T20:28:52.768 INFO:teuthology.orchestra.run.trial047.stdout:Preconfiguring packages ... 2026-02-25T20:28:52.810 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 26.7 MB in 2s (13.7 MB/s) 2026-02-25T20:28:52.827 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libmecab2:amd64. 2026-02-25T20:28:52.872 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 211836 files and directories currently installed.) 2026-02-25T20:28:52.875 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../00-libmecab2_0.996-14build9_amd64.deb ... 2026-02-25T20:28:52.876 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libmecab2:amd64 (0.996-14build9) ... 2026-02-25T20:28:52.894 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libprotobuf-lite23:amd64. 2026-02-25T20:28:52.905 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../01-libprotobuf-lite23_3.12.4-1ubuntu7.22.04.6_amd64.deb ... 2026-02-25T20:28:52.905 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libprotobuf-lite23:amd64 (3.12.4-1ubuntu7.22.04.6) ... 2026-02-25T20:28:52.922 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mysql-server-core-8.0. 2026-02-25T20:28:52.933 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../02-mysql-server-core-8.0_8.0.45-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:28:52.933 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mysql-server-core-8.0 (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:53.233 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mysql-server-8.0. 2026-02-25T20:28:53.243 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../03-mysql-server-8.0_8.0.45-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:28:53.367 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mysql-server-8.0 (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:53.393 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libcgi-pm-perl. 2026-02-25T20:28:53.409 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../04-libcgi-pm-perl_4.54-1_all.deb ... 2026-02-25T20:28:53.409 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libcgi-pm-perl (4.54-1) ... 2026-02-25T20:28:53.432 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libfcgi-perl:amd64. 2026-02-25T20:28:53.448 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../05-libfcgi-perl_0.82+ds-1build1_amd64.deb ... 2026-02-25T20:28:53.449 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libfcgi-perl:amd64 (0.82+ds-1build1) ... 2026-02-25T20:28:53.466 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libcgi-fast-perl. 2026-02-25T20:28:53.481 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../06-libcgi-fast-perl_1%3a2.15-1_all.deb ... 2026-02-25T20:28:53.482 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libcgi-fast-perl (1:2.15-1) ... 2026-02-25T20:28:53.498 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libhtml-template-perl. 2026-02-25T20:28:53.512 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../07-libhtml-template-perl_2.97-1.1_all.deb ... 2026-02-25T20:28:53.513 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libhtml-template-perl (2.97-1.1) ... 2026-02-25T20:28:53.531 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mecab-utils. 2026-02-25T20:28:53.542 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../08-mecab-utils_0.996-14build9_amd64.deb ... 2026-02-25T20:28:53.542 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mecab-utils (0.996-14build9) ... 2026-02-25T20:28:53.558 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mecab-ipadic. 2026-02-25T20:28:53.569 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../09-mecab-ipadic_2.7.0-20070801+main-3_all.deb ... 2026-02-25T20:28:53.570 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mecab-ipadic (2.7.0-20070801+main-3) ... 2026-02-25T20:28:53.896 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mecab-ipadic-utf8. 2026-02-25T20:28:53.912 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../10-mecab-ipadic-utf8_2.7.0-20070801+main-3_all.deb ... 2026-02-25T20:28:53.912 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mecab-ipadic-utf8 (2.7.0-20070801+main-3) ... 2026-02-25T20:28:53.931 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package mysql-server. 2026-02-25T20:28:53.944 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../11-mysql-server_8.0.45-0ubuntu0.22.04.1_all.deb ... 2026-02-25T20:28:53.945 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking mysql-server (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:53.975 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libmecab2:amd64 (0.996-14build9) ... 2026-02-25T20:28:53.976 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libcgi-pm-perl (4.54-1) ... 2026-02-25T20:28:53.977 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libhtml-template-perl (2.97-1.1) ... 2026-02-25T20:28:53.978 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libprotobuf-lite23:amd64 (3.12.4-1ubuntu7.22.04.6) ... 2026-02-25T20:28:53.979 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mecab-utils (0.996-14build9) ... 2026-02-25T20:28:53.980 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mysql-server-core-8.0 (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:53.981 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libfcgi-perl:amd64 (0.82+ds-1build1) ... 2026-02-25T20:28:53.981 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mysql-server-8.0 (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:28:54.056 INFO:teuthology.orchestra.run.trial047.stdout:update-alternatives: using /etc/mysql/mysql.cnf to provide /etc/mysql/my.cnf (my.cnf) in auto mode 2026-02-25T20:28:54.073 INFO:teuthology.orchestra.run.trial047.stdout:Renaming removed key_buffer and myisam-recover options (if present) 2026-02-25T20:28:59.220 INFO:teuthology.orchestra.run.trial047.stdout:mysqld will log errors to /var/log/mysql/error.log 2026-02-25T20:28:59.438 INFO:teuthology.orchestra.run.trial047.stdout:mysqld is running as pid 21791 2026-02-25T20:29:03.853 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/mysql.service → /lib/systemd/system/mysql.service. 2026-02-25T20:29:04.654 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mecab-ipadic (2.7.0-20070801+main-3) ... 2026-02-25T20:29:04.656 INFO:teuthology.orchestra.run.trial047.stdout:Compiling IPA dictionary for Mecab. This takes long time... 2026-02-25T20:29:04.659 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/unk.def ... 40 2026-02-25T20:29:04.659 INFO:teuthology.orchestra.run.trial047.stdout:emitting double-array: 9% |### | emitting double-array: 18% |####### | emitting double-array: 27% |########### | emitting double-array: 36% |############### | emitting double-array: 45% |################### | emitting double-array: 54% |####################### | emitting double-array: 63% |########################### | emitting double-array: 72% |############################### | emitting double-array: 81% |################################### | emitting double-array: 90% |####################################### | emitting double-array: 100% |###########################################| 2026-02-25T20:29:04.659 INFO:teuthology.orchestra.run.trial047.stdout:/usr/share/mecab/dic/ipadic/model.def is not found. skipped. 2026-02-25T20:29:04.659 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Others.csv ... 2 2026-02-25T20:29:04.660 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.adjv.csv ... 3328 2026-02-25T20:29:04.666 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.verbal.csv ... 12146 2026-02-25T20:29:04.682 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.proper.csv ... 27328 2026-02-25T20:29:04.683 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Conjunction.csv ... 171 2026-02-25T20:29:04.725 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.place.csv ... 72999 2026-02-25T20:29:04.725 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Postp-col.csv ... 91 2026-02-25T20:29:04.726 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Interjection.csv ... 252 2026-02-25T20:29:04.726 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.nai.csv ... 42 2026-02-25T20:29:04.726 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.demonst.csv ... 120 2026-02-25T20:29:04.726 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Suffix.csv ... 1393 2026-02-25T20:29:04.727 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.number.csv ... 42 2026-02-25T20:29:04.727 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Auxil.csv ... 199 2026-02-25T20:29:04.728 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Adverb.csv ... 3032 2026-02-25T20:29:04.728 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Postp.csv ... 146 2026-02-25T20:29:04.792 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Verb.csv ... 130750 2026-02-25T20:29:04.812 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.org.csv ... 16668 2026-02-25T20:29:04.812 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Symbol.csv ... 208 2026-02-25T20:29:04.812 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Filler.csv ... 19 2026-02-25T20:29:04.829 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.name.csv ... 34202 2026-02-25T20:29:04.830 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Prefix.csv ... 221 2026-02-25T20:29:04.859 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.csv ... 60477 2026-02-25T20:29:04.859 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Adnominal.csv ... 135 2026-02-25T20:29:04.859 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.others.csv ... 151 2026-02-25T20:29:04.869 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Adj.csv ... 27210 2026-02-25T20:29:04.870 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.adverbal.csv ... 795 2026-02-25T20:29:04.971 INFO:teuthology.orchestra.run.trial047.stdout:emitting double-array: 0% | | emitting double-array: 1% | | emitting double-array: 2% | | emitting double-array: 3% |# | emitting double-array: 4% |# | emitting double-array: 5% |## | emitting double-array: 6% |## | emitting double-array: 7% |### | emitting double-array: 8% |### | emitting double-array: 9% |### | emitting double-array: 10% |#### | emitting double-array: 11% |#### | emitting double-array: 12% |##### | emitting double-array: 13% |##### | emitting double-array: 14% |###### | emitting double-array: 15% |###### | emitting double-array: 16% |###### | emitting double-array: 17% |####### | emitting double-array: 18% |####### | emitting double-array: 19% |######## | emitting double-array: 20% |######## | emitting double-array: 21% |######### | emitting double-array: 22% |######### | emitting double-array: 23% |######### | emitting double-array: 24% |########## | emitting double-array: 25% |########## | emitting double-array: 26% |########### | emitting double-array: 27% |########### | emitting double-array: 28% |############ | emitting double-array: 29% |############ | emitting double-array: 30% |############ | emitting double-array: 31% |############# | emitting double-array: 32% |############# | emitting double-array: 33% |############## | emitting double-array: 34% |############## | emitting double-array: 35% |############### | emitting double-array: 36% |############### | emitting double-array: 37% |############### | emitting double-array: 38% |################ | emitting double-array: 39% |################ | emitting double-array: 40% |################# | emitting double-array: 41% |################# | emitting double-array: 42% |################## | emitting double-array: 43% |################## | emitting double-array: 44% |################## | emitting double-array: 45% |################### | emitting double-array: 46% |################### | emitting double-array: 47% |#################### | emitting double-array: 48% |#################### | emitting double-array: 49% |##################### | emitting double-array: 50% |##################### | emitting double-array: 51% |##################### | emitting double-array: 52% |###################### | emitting double-array: 53% |###################### | emitting double-array: 54% |####################### | emitting double-array: 55% |####################### | emitting double-array: 56% |######################## | emitting double-array: 57% |######################## | emitting double-array: 58% |######################## | emitting double-array: 59% |######################### | emitting double-array: 60% |######################### | emitting double-array: 61% |########################## | emitting double-array: 62% |########################## | emitting double-array: 63% |########################### | emitting double-array: 64% |########################### | emitting double-array: 65% |########################### | emitting double-array: 66% |############################ | emitting double-array: 67% |############################ | emitting double-array: 68% |############################# | emitting double-array: 69% |############################# | emitting double-array: 70% |############################## | emitting double-array: 71% |############################## | emitting double-array: 72% |############################## | emitting double-array: 73% |############################### | emitting double-array: 74% |############################### | emitting double-array: 75% |################################ | emitting double-array: 76% |################################ | emitting double-array: 77% |################################# | emitting double-array: 78% |################################# | emitting double-array: 79% |################################# | emitting double-array: 80% |################################## | emitting double-array: 81% |################################## | emitting double-array: 82% |################################### | emitting double-array: 83% |################################### | emitting double-array: 84% |#################################### | emitting double-array: 85% |#################################### | emitting double-array: 86% |#################################### | emitting double-array: 87% |##################################### | emitting double-array: 88% |##################################### | emitting double-array: 89% |###################################### | emitting double-array: 90% |###################################### | emitting double-array: 91% |####################################### | emitting double-array: 92% |####################################### | emitting double-array: 93% |####################################### | emitting double-array: 94% |######################################## | emitting double-array: 95% |######################################## | emitting double-array: 96% |######################################### | emitting double-array: 97% |######################################### | emitting double-array: 98% |########################################## | emitting double-array: 99% |########################################## | emitting double-array: 100% |###########################################| 2026-02-25T20:29:05.016 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/matrix.def ... 1316x1316 2026-02-25T20:29:05.082 INFO:teuthology.orchestra.run.trial047.stdout:emitting matrix : 0% | | emitting matrix : 1% | | emitting matrix : 2% | | emitting matrix : 3% |# | emitting matrix : 4% |# | emitting matrix : 5% |## | emitting matrix : 6% |## | emitting matrix : 7% |### | emitting matrix : 8% |### | emitting matrix : 9% |### | emitting matrix : 10% |#### | emitting matrix : 11% |#### | emitting matrix : 12% |##### | emitting matrix : 13% |##### | emitting matrix : 14% |###### | emitting matrix : 15% |###### | emitting matrix : 16% |###### | emitting matrix : 17% |####### | emitting matrix : 18% |####### | emitting matrix : 19% |######## | emitting matrix : 20% |######## | emitting matrix : 21% |######### | emitting matrix : 22% |######### | emitting matrix : 23% |######### | emitting matrix : 24% |########## | emitting matrix : 25% |########## | emitting matrix : 26% |########### | emitting matrix : 27% |########### | emitting matrix : 28% |############ | emitting matrix : 29% |############ | emitting matrix : 30% |############ | emitting matrix : 31% |############# | emitting matrix : 32% |############# | emitting matrix : 33% |############## | emitting matrix : 34% |############## | emitting matrix : 35% |############### | emitting matrix : 36% |############### | emitting matrix : 37% |############### | emitting matrix : 38% |################ | emitting matrix : 39% |################ | emitting matrix : 40% |################# | emitting matrix : 41% |################# | emitting matrix : 42% |################## | emitting matrix : 43% |################## | emitting matrix : 44% |################## | emitting matrix : 45% |################### | emitting matrix : 46% |################### | emitting matrix : 47% |#################### | emitting matrix : 48% |#################### | emitting matrix : 49% |##################### | emitting matrix : 50% |##################### | emitting matrix : 51% |##################### | emitting matrix : 52% |###################### | emitting matrix : 53% |###################### | emitting matrix : 54% |####################### | emitting matrix : 55% |####################### | emitting matrix : 56% |######################## | emitting matrix : 57% |######################## | emitting matrix : 58% |######################## | emitting matrix : 59% |######################### | emitting matrix : 60% |######################### | emitting matrix : 61% |########################## | emitting matrix : 62% |########################## | emitting matrix : 63% |########################### | emitting matrix : 64% |########################### | emitting matrix : 65% |########################### | emitting matrix : 66% |############################ | emitting matrix : 67% |############################ | emitting matrix : 68% |############################# | emitting matrix : 69% |############################# | emitting matrix : 70% |############################## | emitting matrix : 71% |############################## | emitting matrix : 72% |############################## | emitting matrix : 73% |############################### | emitting matrix : 74% |############################### | emitting matrix : 75% |################################ | emitting matrix : 76% |################################ | emitting matrix : 77% |################################# | emitting matrix : 78% |################################# | emitting matrix : 79% |################################# | emitting matrix : 80% |################################## | emitting matrix : 81% |################################## | emitting matrix : 82% |################################### | emitting matrix : 83% |################################### | emitting matrix : 84% |#################################### | emitting matrix : 85% |#################################### | emitting matrix : 86% |#################################### | emitting matrix : 87% |##################################### | emitting matrix : 88% |##################################### | emitting matrix : 89% |###################################### | emitting matrix : 90% |###################################### | emitting matrix : 91% |####################################### | emitting matrix : 92% |####################################### | emitting matrix : 93% |####################################### | emitting matrix : 94% |######################################## | emitting matrix : 95% |######################################## | emitting matrix : 96% |######################################### | emitting matrix : 97% |######################################### | emitting matrix : 98% |########################################## | emitting matrix : 99% |########################################## | emitting matrix : 100% |###########################################| 2026-02-25T20:29:05.084 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:05.084 INFO:teuthology.orchestra.run.trial047.stdout:done! 2026-02-25T20:29:05.087 INFO:teuthology.orchestra.run.trial047.stdout:update-alternatives: using /var/lib/mecab/dic/ipadic to provide /var/lib/mecab/dic/debian (mecab-dictionary) in auto mode 2026-02-25T20:29:05.088 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libcgi-fast-perl (1:2.15-1) ... 2026-02-25T20:29:05.089 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mecab-ipadic-utf8 (2.7.0-20070801+main-3) ... 2026-02-25T20:29:05.091 INFO:teuthology.orchestra.run.trial047.stdout:Compiling IPA dictionary for Mecab. This takes long time... 2026-02-25T20:29:05.094 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/unk.def ... 40 2026-02-25T20:29:05.094 INFO:teuthology.orchestra.run.trial047.stdout:emitting double-array: 9% |### | emitting double-array: 18% |####### | emitting double-array: 27% |########### | emitting double-array: 36% |############### | emitting double-array: 45% |################### | emitting double-array: 54% |####################### | emitting double-array: 63% |########################### | emitting double-array: 72% |############################### | emitting double-array: 81% |################################### | emitting double-array: 90% |####################################### | emitting double-array: 100% |###########################################| 2026-02-25T20:29:05.095 INFO:teuthology.orchestra.run.trial047.stdout:/usr/share/mecab/dic/ipadic/model.def is not found. skipped. 2026-02-25T20:29:05.095 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Others.csv ... 2 2026-02-25T20:29:05.097 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.adjv.csv ... 3328 2026-02-25T20:29:05.105 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.verbal.csv ... 12146 2026-02-25T20:29:05.128 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.proper.csv ... 27328 2026-02-25T20:29:05.128 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Conjunction.csv ... 171 2026-02-25T20:29:05.188 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.place.csv ... 72999 2026-02-25T20:29:05.188 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Postp-col.csv ... 91 2026-02-25T20:29:05.188 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Interjection.csv ... 252 2026-02-25T20:29:05.188 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.nai.csv ... 42 2026-02-25T20:29:05.189 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.demonst.csv ... 120 2026-02-25T20:29:05.189 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Suffix.csv ... 1393 2026-02-25T20:29:05.190 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.number.csv ... 42 2026-02-25T20:29:05.190 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Auxil.csv ... 199 2026-02-25T20:29:05.192 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Adverb.csv ... 3032 2026-02-25T20:29:05.192 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Postp.csv ... 146 2026-02-25T20:29:05.297 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Verb.csv ... 130750 2026-02-25T20:29:05.316 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.org.csv ... 16668 2026-02-25T20:29:05.316 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Symbol.csv ... 208 2026-02-25T20:29:05.316 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Filler.csv ... 19 2026-02-25T20:29:05.341 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.name.csv ... 34202 2026-02-25T20:29:05.341 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Prefix.csv ... 221 2026-02-25T20:29:05.383 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.csv ... 60477 2026-02-25T20:29:05.383 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Adnominal.csv ... 135 2026-02-25T20:29:05.383 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.others.csv ... 151 2026-02-25T20:29:05.401 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Adj.csv ... 27210 2026-02-25T20:29:05.402 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/Noun.adverbal.csv ... 795 2026-02-25T20:29:05.522 INFO:teuthology.orchestra.run.trial047.stdout:emitting double-array: 0% | | emitting double-array: 1% | | emitting double-array: 2% | | emitting double-array: 3% |# | emitting double-array: 4% |# | emitting double-array: 5% |## | emitting double-array: 6% |## | emitting double-array: 7% |### | emitting double-array: 8% |### | emitting double-array: 9% |### | emitting double-array: 10% |#### | emitting double-array: 11% |#### | emitting double-array: 12% |##### | emitting double-array: 13% |##### | emitting double-array: 14% |###### | emitting double-array: 15% |###### | emitting double-array: 16% |###### | emitting double-array: 17% |####### | emitting double-array: 18% |####### | emitting double-array: 19% |######## | emitting double-array: 20% |######## | emitting double-array: 21% |######### | emitting double-array: 22% |######### | emitting double-array: 23% |######### | emitting double-array: 24% |########## | emitting double-array: 25% |########## | emitting double-array: 26% |########### | emitting double-array: 27% |########### | emitting double-array: 28% |############ | emitting double-array: 29% |############ | emitting double-array: 30% |############ | emitting double-array: 31% |############# | emitting double-array: 32% |############# | emitting double-array: 33% |############## | emitting double-array: 34% |############## | emitting double-array: 35% |############### | emitting double-array: 36% |############### | emitting double-array: 37% |############### | emitting double-array: 38% |################ | emitting double-array: 39% |################ | emitting double-array: 40% |################# | emitting double-array: 41% |################# | emitting double-array: 42% |################## | emitting double-array: 43% |################## | emitting double-array: 44% |################## | emitting double-array: 45% |################### | emitting double-array: 46% |################### | emitting double-array: 47% |#################### | emitting double-array: 48% |#################### | emitting double-array: 49% |##################### | emitting double-array: 50% |##################### | emitting double-array: 51% |##################### | emitting double-array: 52% |###################### | emitting double-array: 53% |###################### | emitting double-array: 54% |####################### | emitting double-array: 55% |####################### | emitting double-array: 56% |######################## | emitting double-array: 57% |######################## | emitting double-array: 58% |######################## | emitting double-array: 59% |######################### | emitting double-array: 60% |######################### | emitting double-array: 61% |########################## | emitting double-array: 62% |########################## | emitting double-array: 63% |########################### | emitting double-array: 64% |########################### | emitting double-array: 65% |########################### | emitting double-array: 66% |############################ | emitting double-array: 67% |############################ | emitting double-array: 68% |############################# | emitting double-array: 69% |############################# | emitting double-array: 70% |############################## | emitting double-array: 71% |############################## | emitting double-array: 72% |############################## | emitting double-array: 73% |############################### | emitting double-array: 74% |############################### | emitting double-array: 75% |################################ | emitting double-array: 76% |################################ | emitting double-array: 77% |################################# | emitting double-array: 78% |################################# | emitting double-array: 79% |################################# | emitting double-array: 80% |################################## | emitting double-array: 81% |################################## | emitting double-array: 82% |################################### | emitting double-array: 83% |################################### | emitting double-array: 84% |#################################### | emitting double-array: 85% |#################################### | emitting double-array: 86% |#################################### | emitting double-array: 87% |##################################### | emitting double-array: 88% |##################################### | emitting double-array: 89% |###################################### | emitting double-array: 90% |###################################### | emitting double-array: 91% |####################################### | emitting double-array: 92% |####################################### | emitting double-array: 93% |####################################### | emitting double-array: 94% |######################################## | emitting double-array: 95% |######################################## | emitting double-array: 96% |######################################### | emitting double-array: 97% |######################################### | emitting double-array: 98% |########################################## | emitting double-array: 99% |########################################## | emitting double-array: 100% |###########################################| 2026-02-25T20:29:05.573 INFO:teuthology.orchestra.run.trial047.stdout:reading /usr/share/mecab/dic/ipadic/matrix.def ... 1316x1316 2026-02-25T20:29:05.640 INFO:teuthology.orchestra.run.trial047.stdout:emitting matrix : 0% | | emitting matrix : 1% | | emitting matrix : 2% | | emitting matrix : 3% |# | emitting matrix : 4% |# | emitting matrix : 5% |## | emitting matrix : 6% |## | emitting matrix : 7% |### | emitting matrix : 8% |### | emitting matrix : 9% |### | emitting matrix : 10% |#### | emitting matrix : 11% |#### | emitting matrix : 12% |##### | emitting matrix : 13% |##### | emitting matrix : 14% |###### | emitting matrix : 15% |###### | emitting matrix : 16% |###### | emitting matrix : 17% |####### | emitting matrix : 18% |####### | emitting matrix : 19% |######## | emitting matrix : 20% |######## | emitting matrix : 21% |######### | emitting matrix : 22% |######### | emitting matrix : 23% |######### | emitting matrix : 24% |########## | emitting matrix : 25% |########## | emitting matrix : 26% |########### | emitting matrix : 27% |########### | emitting matrix : 28% |############ | emitting matrix : 29% |############ | emitting matrix : 30% |############ | emitting matrix : 31% |############# | emitting matrix : 32% |############# | emitting matrix : 33% |############## | emitting matrix : 34% |############## | emitting matrix : 35% |############### | emitting matrix : 36% |############### | emitting matrix : 37% |############### | emitting matrix : 38% |################ | emitting matrix : 39% |################ | emitting matrix : 40% |################# | emitting matrix : 41% |################# | emitting matrix : 42% |################## | emitting matrix : 43% |################## | emitting matrix : 44% |################## | emitting matrix : 45% |################### | emitting matrix : 46% |################### | emitting matrix : 47% |#################### | emitting matrix : 48% |#################### | emitting matrix : 49% |##################### | emitting matrix : 50% |##################### | emitting matrix : 51% |##################### | emitting matrix : 52% |###################### | emitting matrix : 53% |###################### | emitting matrix : 54% |####################### | emitting matrix : 55% |####################### | emitting matrix : 56% |######################## | emitting matrix : 57% |######################## | emitting matrix : 58% |######################## | emitting matrix : 59% |######################### | emitting matrix : 60% |######################### | emitting matrix : 61% |########################## | emitting matrix : 62% |########################## | emitting matrix : 63% |########################### | emitting matrix : 64% |########################### | emitting matrix : 65% |########################### | emitting matrix : 66% |############################ | emitting matrix : 67% |############################ | emitting matrix : 68% |############################# | emitting matrix : 69% |############################# | emitting matrix : 70% |############################## | emitting matrix : 71% |############################## | emitting matrix : 72% |############################## | emitting matrix : 73% |############################### | emitting matrix : 74% |############################### | emitting matrix : 75% |################################ | emitting matrix : 76% |################################ | emitting matrix : 77% |################################# | emitting matrix : 78% |################################# | emitting matrix : 79% |################################# | emitting matrix : 80% |################################## | emitting matrix : 81% |################################## | emitting matrix : 82% |################################### | emitting matrix : 83% |################################### | emitting matrix : 84% |#################################### | emitting matrix : 85% |#################################### | emitting matrix : 86% |#################################### | emitting matrix : 87% |##################################### | emitting matrix : 88% |##################################### | emitting matrix : 89% |###################################### | emitting matrix : 90% |###################################### | emitting matrix : 91% |####################################### | emitting matrix : 92% |####################################### | emitting matrix : 93% |####################################### | emitting matrix : 94% |######################################## | emitting matrix : 95% |######################################## | emitting matrix : 96% |######################################### | emitting matrix : 97% |######################################### | emitting matrix : 98% |########################################## | emitting matrix : 99% |########################################## | emitting matrix : 100% |###########################################| 2026-02-25T20:29:05.643 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:05.643 INFO:teuthology.orchestra.run.trial047.stdout:done! 2026-02-25T20:29:05.646 INFO:teuthology.orchestra.run.trial047.stdout:update-alternatives: using /var/lib/mecab/dic/ipadic-utf8 to provide /var/lib/mecab/dic/debian (mecab-dictionary) in auto mode 2026-02-25T20:29:05.647 INFO:teuthology.orchestra.run.trial047.stdout:Setting up mysql-server (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:29:05.649 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:29:05.716 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-25T20:29:06.315 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:06.315 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:29:06.315 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:06.315 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:29:06.315 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:06.315 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:29:06.315 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:06.315 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:29:06.316 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:06.316 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:29:06.316 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:06.316 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:29:07.157 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:29:07.161 INFO:teuthology.packaging:Installing package postgresql on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:29:07.161 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install postgresql 2026-02-25T20:29:07.235 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:29:07.344 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:29:07.345 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:29:07.434 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:29:07.434 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout:The following additional packages will be installed: 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout: libjson-perl libllvm14 libpq5 postgresql-14 postgresql-client-14 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout: postgresql-client-common postgresql-common 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout:Suggested packages: 2026-02-25T20:29:07.435 INFO:teuthology.orchestra.run.trial047.stdout: postgresql-doc postgresql-doc-14 2026-02-25T20:29:07.447 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:29:07.447 INFO:teuthology.orchestra.run.trial047.stdout: libjson-perl libllvm14 libpq5 postgresql postgresql-14 postgresql-client-14 2026-02-25T20:29:07.447 INFO:teuthology.orchestra.run.trial047.stdout: postgresql-client-common postgresql-common 2026-02-25T20:29:07.859 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 8 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:29:07.860 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 41.9 MB of archives. 2026-02-25T20:29:07.860 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 160 MB of additional disk space will be used. 2026-02-25T20:29:07.860 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2026-02-25T20:29:08.167 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2026-02-25T20:29:09.243 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.20-0ubuntu0.22.04.1 [153 kB] 2026-02-25T20:29:09.244 INFO:teuthology.orchestra.run.trial047.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2026-02-25T20:29:09.245 INFO:teuthology.orchestra.run.trial047.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.20-0ubuntu0.22.04.1 [1250 kB] 2026-02-25T20:29:09.279 INFO:teuthology.orchestra.run.trial047.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2026-02-25T20:29:09.283 INFO:teuthology.orchestra.run.trial047.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.20-0ubuntu0.22.04.1 [16.2 MB] 2026-02-25T20:29:09.747 INFO:teuthology.orchestra.run.trial047.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3288 B] 2026-02-25T20:29:09.785 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:29:09.785 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:29:09.788 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:29:09.788 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:29:09.789 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:29:09.789 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:29:09.910 INFO:teuthology.orchestra.run.trial047.stdout:Preconfiguring packages ... 2026-02-25T20:29:09.955 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 41.9 MB in 2s (18.2 MB/s) 2026-02-25T20:29:09.972 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libjson-perl. 2026-02-25T20:29:10.019 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 212148 files and directories currently installed.) 2026-02-25T20:29:10.021 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../0-libjson-perl_4.04000-1_all.deb ... 2026-02-25T20:29:10.022 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libjson-perl (4.04000-1) ... 2026-02-25T20:29:10.038 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libllvm14:amd64. 2026-02-25T20:29:10.049 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../1-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:10.049 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:10.324 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libpq5:amd64. 2026-02-25T20:29:10.339 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../2-libpq5_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:29:10.340 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libpq5:amd64 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:10.357 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package postgresql-client-common. 2026-02-25T20:29:10.372 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../3-postgresql-client-common_238_all.deb ... 2026-02-25T20:29:10.373 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking postgresql-client-common (238) ... 2026-02-25T20:29:10.391 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package postgresql-client-14. 2026-02-25T20:29:10.403 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../4-postgresql-client-14_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:29:10.404 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking postgresql-client-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:10.445 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package postgresql-common. 2026-02-25T20:29:10.456 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../5-postgresql-common_238_all.deb ... 2026-02-25T20:29:10.464 INFO:teuthology.orchestra.run.trial047.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2026-02-25T20:29:10.468 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking postgresql-common (238) ... 2026-02-25T20:29:10.494 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package postgresql-14. 2026-02-25T20:29:10.504 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../6-postgresql-14_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:29:10.506 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking postgresql-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:10.694 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package postgresql. 2026-02-25T20:29:10.706 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../7-postgresql_14+238_all.deb ... 2026-02-25T20:29:10.706 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking postgresql (14+238) ... 2026-02-25T20:29:10.733 INFO:teuthology.orchestra.run.trial047.stdout:Setting up postgresql-client-common (238) ... 2026-02-25T20:29:10.735 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libpq5:amd64 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:10.736 INFO:teuthology.orchestra.run.trial047.stdout:Setting up postgresql-client-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:11.171 INFO:teuthology.orchestra.run.trial047.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2026-02-25T20:29:11.191 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:11.192 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libjson-perl (4.04000-1) ... 2026-02-25T20:29:11.193 INFO:teuthology.orchestra.run.trial047.stdout:Setting up postgresql-common (238) ... 2026-02-25T20:29:11.341 INFO:teuthology.orchestra.run.trial047.stdout:Adding user postgres to group ssl-cert 2026-02-25T20:29:11.409 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:11.410 INFO:teuthology.orchestra.run.trial047.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2026-02-25T20:29:11.516 INFO:teuthology.orchestra.run.trial047.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2026-02-25T20:29:11.516 INFO:teuthology.orchestra.run.trial047.stdout:Removing obsolete dictionary files: 2026-02-25T20:29:11.973 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service → /lib/systemd/system/postgresql.service. 2026-02-25T20:29:12.155 INFO:teuthology.orchestra.run.trial047.stdout:Setting up postgresql-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:12.260 INFO:teuthology.orchestra.run.trial047.stdout:Creating new PostgreSQL cluster 14/main ... 2026-02-25T20:29:12.265 INFO:teuthology.orchestra.run.trial047.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2026-02-25T20:29:12.273 INFO:teuthology.orchestra.run.trial047.stdout:The files belonging to this database system will be owned by user "postgres". 2026-02-25T20:29:12.274 INFO:teuthology.orchestra.run.trial047.stdout:This user must also own the server process. 2026-02-25T20:29:12.274 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:12.274 INFO:teuthology.orchestra.run.trial047.stdout:The database cluster will be initialized with locale "C.UTF-8". 2026-02-25T20:29:12.274 INFO:teuthology.orchestra.run.trial047.stdout:The default database encoding has accordingly been set to "UTF8". 2026-02-25T20:29:12.274 INFO:teuthology.orchestra.run.trial047.stdout:The default text search configuration will be set to "english". 2026-02-25T20:29:12.274 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:12.274 INFO:teuthology.orchestra.run.trial047.stdout:Data page checksums are disabled. 2026-02-25T20:29:12.274 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:12.275 INFO:teuthology.orchestra.run.trial047.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2026-02-25T20:29:12.275 INFO:teuthology.orchestra.run.trial047.stdout:creating subdirectories ... ok 2026-02-25T20:29:12.275 INFO:teuthology.orchestra.run.trial047.stdout:selecting dynamic shared memory implementation ... posix 2026-02-25T20:29:12.284 INFO:teuthology.orchestra.run.trial047.stdout:selecting default max_connections ... 100 2026-02-25T20:29:12.296 INFO:teuthology.orchestra.run.trial047.stdout:selecting default shared_buffers ... 128MB 2026-02-25T20:29:12.308 INFO:teuthology.orchestra.run.trial047.stdout:selecting default time zone ... Etc/UTC 2026-02-25T20:29:12.309 INFO:teuthology.orchestra.run.trial047.stdout:creating configuration files ... ok 2026-02-25T20:29:12.376 INFO:teuthology.orchestra.run.trial047.stdout:running bootstrap script ... ok 2026-02-25T20:29:12.581 INFO:teuthology.orchestra.run.trial047.stdout:performing post-bootstrap initialization ... ok 2026-02-25T20:29:12.619 INFO:teuthology.orchestra.run.trial047.stdout:syncing data to disk ... ok 2026-02-25T20:29:12.933 INFO:teuthology.orchestra.run.trial047.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2026-02-25T20:29:15.363 INFO:teuthology.orchestra.run.trial047.stdout:Setting up postgresql (14+238) ... 2026-02-25T20:29:15.364 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:29:15.463 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-25T20:29:16.083 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:16.083 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:29:16.083 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:16.083 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:29:16.083 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:16.083 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:29:16.083 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:16.084 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:29:16.084 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:16.084 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:29:16.084 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:16.084 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:29:16.890 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:29:16.894 INFO:teuthology.packaging:Installing package postgresql-client on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:29:16.894 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install postgresql-client 2026-02-25T20:29:16.969 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:29:17.080 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:29:17.080 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:29:17.167 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:29:17.167 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:29:17.167 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:29:17.167 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:29:17.167 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:29:17.167 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:29:17.167 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:29:17.177 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:29:17.178 INFO:teuthology.orchestra.run.trial047.stdout: postgresql-client 2026-02-25T20:29:17.599 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 1 newly installed, 0 to remove and 31 not upgraded. 2026-02-25T20:29:17.600 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 3292 B of archives. 2026-02-25T20:29:17.600 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 71.7 kB of additional disk space will be used. 2026-02-25T20:29:17.600 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3292 B] 2026-02-25T20:29:17.786 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 3292 B in 0s (7844 B/s) 2026-02-25T20:29:17.804 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package postgresql-client. 2026-02-25T20:29:17.848 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 213994 files and directories currently installed.) 2026-02-25T20:29:17.851 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../postgresql-client_14+238_all.deb ... 2026-02-25T20:29:17.851 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking postgresql-client (14+238) ... 2026-02-25T20:29:17.877 INFO:teuthology.orchestra.run.trial047.stdout:Setting up postgresql-client (14+238) ... 2026-02-25T20:29:18.472 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:18.472 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:29:18.472 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:18.472 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:29:18.473 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:18.473 INFO:teuthology.orchestra.run.trial047.stdout:No services need to be restarted. 2026-02-25T20:29:18.473 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:18.473 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:29:18.473 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:18.473 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:29:18.473 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:18.473 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:29:19.312 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:29:19.315 INFO:teuthology.packaging:Installing package postgresql-server-dev-all on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:29:19.315 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install postgresql-server-dev-all 2026-02-25T20:29:19.390 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:29:19.501 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:29:19.502 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:29:19.597 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:29:19.597 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:29:19.597 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-25T20:29:19.597 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:29:19.597 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:29:19.597 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-25T20:29:19.597 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout:The following additional packages will be installed: 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: binfmt-support clang-14 cpp-11 g++-11 gcc-11 gcc-11-base gcc-12-base 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: gfortran-11 lib32gcc-s1 lib32stdc++6 libasan6 libatomic1 libcc1-0 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: libclang-common-14-dev libclang-cpp14 libclang1-14 libgc1 libgcc-11-dev 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: libgcc-s1 libgfortran-11-dev libgfortran5 libgomp1 libitm1 liblsan0 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: libobjc-11-dev libobjc4 libpfm4 libpq-dev libquadmath0 libstdc++-11-dev 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: libstdc++6 libtsan0 libubsan1 libz3-4 libz3-dev llvm-14 llvm-14-dev 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14-linker-tools llvm-14-runtime llvm-14-tools postgresql-server-dev-14 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout:Suggested packages: 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: clang-14-doc gcc-11-locales g++-11-multilib gcc-11-doc gcc-11-multilib 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: gfortran-11-multilib gfortran-11-doc libcoarrays-dev postgresql-doc-14 2026-02-25T20:29:19.598 INFO:teuthology.orchestra.run.trial047.stdout: libstdc++-11-doc llvm-14-doc 2026-02-25T20:29:19.620 INFO:teuthology.orchestra.run.trial047.stdout:The following NEW packages will be installed: 2026-02-25T20:29:19.620 INFO:teuthology.orchestra.run.trial047.stdout: binfmt-support clang-14 lib32gcc-s1 lib32stdc++6 libclang-common-14-dev 2026-02-25T20:29:19.620 INFO:teuthology.orchestra.run.trial047.stdout: libclang-cpp14 libclang1-14 libgc1 libobjc-11-dev libobjc4 libpfm4 libpq-dev 2026-02-25T20:29:19.620 INFO:teuthology.orchestra.run.trial047.stdout: libz3-4 libz3-dev llvm-14 llvm-14-dev llvm-14-linker-tools llvm-14-runtime 2026-02-25T20:29:19.620 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14-tools postgresql-server-dev-14 postgresql-server-dev-all 2026-02-25T20:29:19.620 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be upgraded: 2026-02-25T20:29:19.620 INFO:teuthology.orchestra.run.trial047.stdout: cpp-11 g++-11 gcc-11 gcc-11-base gcc-12-base gfortran-11 libasan6 libatomic1 2026-02-25T20:29:19.621 INFO:teuthology.orchestra.run.trial047.stdout: libcc1-0 libgcc-11-dev libgcc-s1 libgfortran-11-dev libgfortran5 libgomp1 2026-02-25T20:29:19.621 INFO:teuthology.orchestra.run.trial047.stdout: libitm1 liblsan0 libquadmath0 libstdc++-11-dev libstdc++6 libtsan0 libubsan1 2026-02-25T20:29:19.975 INFO:teuthology.orchestra.run.trial047.stdout:21 upgraded, 21 newly installed, 0 to remove and 10 not upgraded. 2026-02-25T20:29:19.975 INFO:teuthology.orchestra.run.trial047.stdout:Need to get 154 MB of archives. 2026-02-25T20:29:19.975 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 533 MB of additional disk space will be used. 2026-02-25T20:29:19.975 INFO:teuthology.orchestra.run.trial047.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libatomic1 amd64 12.3.0-1ubuntu1~22.04.3 [10.5 kB] 2026-02-25T20:29:20.062 INFO:teuthology.orchestra.run.trial047.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libubsan1 amd64 12.3.0-1ubuntu1~22.04.3 [976 kB] 2026-02-25T20:29:20.450 INFO:teuthology.orchestra.run.trial047.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gcc-12-base amd64 12.3.0-1ubuntu1~22.04.3 [216 kB] 2026-02-25T20:29:20.470 INFO:teuthology.orchestra.run.trial047.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libstdc++6 amd64 12.3.0-1ubuntu1~22.04.3 [699 kB] 2026-02-25T20:29:20.518 INFO:teuthology.orchestra.run.trial047.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libquadmath0 amd64 12.3.0-1ubuntu1~22.04.3 [154 kB] 2026-02-25T20:29:20.526 INFO:teuthology.orchestra.run.trial047.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liblsan0 amd64 12.3.0-1ubuntu1~22.04.3 [1069 kB] 2026-02-25T20:29:20.569 INFO:teuthology.orchestra.run.trial047.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libitm1 amd64 12.3.0-1ubuntu1~22.04.3 [30.2 kB] 2026-02-25T20:29:20.570 INFO:teuthology.orchestra.run.trial047.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgomp1 amd64 12.3.0-1ubuntu1~22.04.3 [127 kB] 2026-02-25T20:29:20.574 INFO:teuthology.orchestra.run.trial047.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgfortran5 amd64 12.3.0-1ubuntu1~22.04.3 [879 kB] 2026-02-25T20:29:20.599 INFO:teuthology.orchestra.run.trial047.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcc1-0 amd64 12.3.0-1ubuntu1~22.04.3 [48.3 kB] 2026-02-25T20:29:20.599 INFO:teuthology.orchestra.run.trial047.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgcc-s1 amd64 12.3.0-1ubuntu1~22.04.3 [53.9 kB] 2026-02-25T20:29:20.601 INFO:teuthology.orchestra.run.trial047.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/main amd64 binfmt-support amd64 2.2.1-2 [55.8 kB] 2026-02-25T20:29:20.602 INFO:teuthology.orchestra.run.trial047.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libclang-cpp14 amd64 1:14.0.0-1ubuntu1.1 [12.1 MB] 2026-02-25T20:29:20.885 INFO:teuthology.orchestra.run.trial047.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libasan6 amd64 11.4.0-1ubuntu1~22.04.3 [2283 kB] 2026-02-25T20:29:20.932 INFO:teuthology.orchestra.run.trial047.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 g++-11 amd64 11.4.0-1ubuntu1~22.04.3 [11.4 MB] 2026-02-25T20:29:21.204 INFO:teuthology.orchestra.run.trial047.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gfortran-11 amd64 11.4.0-1ubuntu1~22.04.3 [11.2 MB] 2026-02-25T20:29:21.463 INFO:teuthology.orchestra.run.trial047.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gcc-11 amd64 11.4.0-1ubuntu1~22.04.3 [20.1 MB] 2026-02-25T20:29:21.933 INFO:teuthology.orchestra.run.trial047.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libstdc++-11-dev amd64 11.4.0-1ubuntu1~22.04.3 [2101 kB] 2026-02-25T20:29:21.979 INFO:teuthology.orchestra.run.trial047.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgfortran-11-dev amd64 11.4.0-1ubuntu1~22.04.3 [842 kB] 2026-02-25T20:29:22.000 INFO:teuthology.orchestra.run.trial047.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgcc-11-dev amd64 11.4.0-1ubuntu1~22.04.3 [2517 kB] 2026-02-25T20:29:22.058 INFO:teuthology.orchestra.run.trial047.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libtsan0 amd64 11.4.0-1ubuntu1~22.04.3 [2260 kB] 2026-02-25T20:29:22.111 INFO:teuthology.orchestra.run.trial047.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cpp-11 amd64 11.4.0-1ubuntu1~22.04.3 [10.0 MB] 2026-02-25T20:29:22.344 INFO:teuthology.orchestra.run.trial047.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gcc-11-base amd64 11.4.0-1ubuntu1~22.04.3 [216 kB] 2026-02-25T20:29:22.348 INFO:teuthology.orchestra.run.trial047.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 libgc1 amd64 1:8.0.6-1.1build1 [96.8 kB] 2026-02-25T20:29:22.351 INFO:teuthology.orchestra.run.trial047.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libobjc4 amd64 12.3.0-1ubuntu1~22.04.3 [48.7 kB] 2026-02-25T20:29:22.352 INFO:teuthology.orchestra.run.trial047.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libobjc-11-dev amd64 11.4.0-1ubuntu1~22.04.3 [196 kB] 2026-02-25T20:29:22.356 INFO:teuthology.orchestra.run.trial047.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 lib32gcc-s1 amd64 12.3.0-1ubuntu1~22.04.3 [63.9 kB] 2026-02-25T20:29:22.357 INFO:teuthology.orchestra.run.trial047.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 lib32stdc++6 amd64 12.3.0-1ubuntu1~22.04.3 [739 kB] 2026-02-25T20:29:22.376 INFO:teuthology.orchestra.run.trial047.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libclang-common-14-dev amd64 1:14.0.0-1ubuntu1.1 [5975 kB] 2026-02-25T20:29:22.514 INFO:teuthology.orchestra.run.trial047.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 llvm-14-linker-tools amd64 1:14.0.0-1ubuntu1.1 [1355 kB] 2026-02-25T20:29:22.544 INFO:teuthology.orchestra.run.trial047.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libclang1-14 amd64 1:14.0.0-1ubuntu1.1 [6792 kB] 2026-02-25T20:29:22.701 INFO:teuthology.orchestra.run.trial047.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 clang-14 amd64 1:14.0.0-1ubuntu1.1 [81.2 kB] 2026-02-25T20:29:22.703 INFO:teuthology.orchestra.run.trial047.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq-dev amd64 14.20-0ubuntu0.22.04.1 [149 kB] 2026-02-25T20:29:22.707 INFO:teuthology.orchestra.run.trial047.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 llvm-14-runtime amd64 1:14.0.0-1ubuntu1.1 [484 kB] 2026-02-25T20:29:22.718 INFO:teuthology.orchestra.run.trial047.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpfm4 amd64 4.11.1+git32-gd0b85fb-1ubuntu0.1 [345 kB] 2026-02-25T20:29:22.727 INFO:teuthology.orchestra.run.trial047.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 llvm-14 amd64 1:14.0.0-1ubuntu1.1 [12.7 MB] 2026-02-25T20:29:23.023 INFO:teuthology.orchestra.run.trial047.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 llvm-14-tools amd64 1:14.0.0-1ubuntu1.1 [404 kB] 2026-02-25T20:29:23.030 INFO:teuthology.orchestra.run.trial047.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libz3-4 amd64 4.8.12-1 [5766 kB] 2026-02-25T20:29:23.165 INFO:teuthology.orchestra.run.trial047.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libz3-dev amd64 4.8.12-1 [72.2 kB] 2026-02-25T20:29:23.166 INFO:teuthology.orchestra.run.trial047.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 llvm-14-dev amd64 1:14.0.0-1ubuntu1.1 [37.8 MB] 2026-02-25T20:29:24.047 INFO:teuthology.orchestra.run.trial047.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 postgresql-server-dev-14 amd64 14.20-0ubuntu0.22.04.1 [1182 kB] 2026-02-25T20:29:24.068 INFO:teuthology.orchestra.run.trial047.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 postgresql-server-dev-all amd64 238 [14.0 kB] 2026-02-25T20:29:24.289 INFO:teuthology.orchestra.run.trial047.stdout:Fetched 154 MB in 4s (34.6 MB/s) 2026-02-25T20:29:24.350 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 213997 files and directories currently installed.) 2026-02-25T20:29:24.353 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libatomic1_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.354 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libatomic1:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.381 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libubsan1_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.382 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libubsan1:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.416 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../gcc-12-base_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.416 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking gcc-12-base:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.444 INFO:teuthology.orchestra.run.trial047.stdout:Setting up gcc-12-base:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:24.504 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 213997 files and directories currently installed.) 2026-02-25T20:29:24.507 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../libstdc++6_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.526 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libstdc++6:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.559 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libstdc++6:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:24.621 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 213997 files and directories currently installed.) 2026-02-25T20:29:24.624 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../0-libquadmath0_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.625 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libquadmath0:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.652 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../1-liblsan0_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.653 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking liblsan0:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.687 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../2-libitm1_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.688 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libitm1:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.714 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../3-libgomp1_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.715 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libgomp1:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.741 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../4-libgfortran5_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.743 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libgfortran5:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.776 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../5-libcc1-0_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.777 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libcc1-0:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.802 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../6-libgcc-s1_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:24.803 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libgcc-s1:amd64 (12.3.0-1ubuntu1~22.04.3) over (12.3.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:24.831 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libgcc-s1:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:24.856 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package binfmt-support. 2026-02-25T20:29:24.907 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 213997 files and directories currently installed.) 2026-02-25T20:29:24.910 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../00-binfmt-support_2.2.1-2_amd64.deb ... 2026-02-25T20:29:24.910 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking binfmt-support (2.2.1-2) ... 2026-02-25T20:29:24.928 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libclang-cpp14. 2026-02-25T20:29:24.939 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../01-libclang-cpp14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:24.940 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libclang-cpp14 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:25.103 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../02-libasan6_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.104 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libasan6:amd64 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.151 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../03-g++-11_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.151 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking g++-11 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.252 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../04-gfortran-11_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.253 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking gfortran-11 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.358 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../05-gcc-11_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.359 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking gcc-11 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.507 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../06-libstdc++-11-dev_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.508 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libstdc++-11-dev:amd64 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.645 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../07-libgfortran-11-dev_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.646 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libgfortran-11-dev:amd64 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.684 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../08-libgcc-11-dev_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.685 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libgcc-11-dev:amd64 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.752 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../09-libtsan0_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.753 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libtsan0:amd64 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.799 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../10-cpp-11_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.800 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking cpp-11 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.899 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../11-gcc-11-base_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.900 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking gcc-11-base:amd64 (11.4.0-1ubuntu1~22.04.3) over (11.4.0-1ubuntu1~22.04.2) ... 2026-02-25T20:29:25.917 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libgc1:amd64. 2026-02-25T20:29:25.928 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../12-libgc1_1%3a8.0.6-1.1build1_amd64.deb ... 2026-02-25T20:29:25.928 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libgc1:amd64 (1:8.0.6-1.1build1) ... 2026-02-25T20:29:25.944 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libobjc4:amd64. 2026-02-25T20:29:25.955 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../13-libobjc4_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.956 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libobjc4:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:25.971 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libobjc-11-dev:amd64. 2026-02-25T20:29:25.982 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../14-libobjc-11-dev_11.4.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:25.982 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libobjc-11-dev:amd64 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:26.002 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package lib32gcc-s1. 2026-02-25T20:29:26.012 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../15-lib32gcc-s1_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:26.013 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking lib32gcc-s1 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:26.029 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package lib32stdc++6. 2026-02-25T20:29:26.040 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../16-lib32stdc++6_12.3.0-1ubuntu1~22.04.3_amd64.deb ... 2026-02-25T20:29:26.040 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking lib32stdc++6 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:26.062 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libclang-common-14-dev. 2026-02-25T20:29:26.073 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../17-libclang-common-14-dev_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:26.073 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libclang-common-14-dev (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:26.257 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package llvm-14-linker-tools. 2026-02-25T20:29:26.268 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../18-llvm-14-linker-tools_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:26.268 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking llvm-14-linker-tools (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:26.295 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libclang1-14. 2026-02-25T20:29:26.306 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../19-libclang1-14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:26.306 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libclang1-14 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:26.395 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package clang-14. 2026-02-25T20:29:26.406 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../20-clang-14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:26.407 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking clang-14 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:26.424 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libpq-dev. 2026-02-25T20:29:26.435 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../21-libpq-dev_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:29:26.435 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libpq-dev (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:26.453 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package llvm-14-runtime. 2026-02-25T20:29:26.464 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../22-llvm-14-runtime_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:26.464 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking llvm-14-runtime (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:26.484 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libpfm4:amd64. 2026-02-25T20:29:26.495 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../23-libpfm4_4.11.1+git32-gd0b85fb-1ubuntu0.1_amd64.deb ... 2026-02-25T20:29:26.495 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libpfm4:amd64 (4.11.1+git32-gd0b85fb-1ubuntu0.1) ... 2026-02-25T20:29:26.515 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package llvm-14. 2026-02-25T20:29:26.526 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../24-llvm-14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:26.526 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking llvm-14 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:26.644 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package llvm-14-tools. 2026-02-25T20:29:26.655 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../25-llvm-14-tools_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:26.655 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking llvm-14-tools (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:26.708 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libz3-4:amd64. 2026-02-25T20:29:26.719 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../26-libz3-4_4.8.12-1_amd64.deb ... 2026-02-25T20:29:26.719 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libz3-4:amd64 (4.8.12-1) ... 2026-02-25T20:29:26.776 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package libz3-dev:amd64. 2026-02-25T20:29:26.787 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../27-libz3-dev_4.8.12-1_amd64.deb ... 2026-02-25T20:29:26.795 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking libz3-dev:amd64 (4.8.12-1) ... 2026-02-25T20:29:26.806 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package llvm-14-dev. 2026-02-25T20:29:26.816 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../28-llvm-14-dev_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2026-02-25T20:29:26.817 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking llvm-14-dev (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:27.515 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package postgresql-server-dev-14. 2026-02-25T20:29:27.526 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../29-postgresql-server-dev-14_14.20-0ubuntu0.22.04.1_amd64.deb ... 2026-02-25T20:29:27.526 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking postgresql-server-dev-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:27.617 INFO:teuthology.orchestra.run.trial047.stdout:Selecting previously unselected package postgresql-server-dev-all:amd64. 2026-02-25T20:29:27.629 INFO:teuthology.orchestra.run.trial047.stdout:Preparing to unpack .../30-postgresql-server-dev-all_238_amd64.deb ... 2026-02-25T20:29:27.630 INFO:teuthology.orchestra.run.trial047.stdout:Unpacking postgresql-server-dev-all:amd64 (238) ... 2026-02-25T20:29:27.661 INFO:teuthology.orchestra.run.trial047.stdout:Setting up gcc-11-base:amd64 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:27.662 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libclang1-14 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:27.663 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libpq-dev (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:27.664 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libgomp1:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:27.664 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libasan6:amd64 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:27.665 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libz3-4:amd64 (4.8.12-1) ... 2026-02-25T20:29:27.666 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libpfm4:amd64 (4.11.1+git32-gd0b85fb-1ubuntu0.1) ... 2026-02-25T20:29:27.667 INFO:teuthology.orchestra.run.trial047.stdout:Setting up llvm-14-runtime (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:27.669 INFO:teuthology.orchestra.run.trial047.stdout:Setting up lib32gcc-s1 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:27.670 INFO:teuthology.orchestra.run.trial047.stdout:Setting up lib32stdc++6 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:27.672 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libquadmath0:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:27.673 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libclang-common-14-dev (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:27.673 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libatomic1:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:27.674 INFO:teuthology.orchestra.run.trial047.stdout:Setting up binfmt-support (2.2.1-2) ... 2026-02-25T20:29:27.676 INFO:teuthology.orchestra.run.trial047.stdout:update-binfmts: warning: python3.10 already enabled in kernel. 2026-02-25T20:29:27.987 INFO:teuthology.orchestra.run.trial047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/binfmt-support.service → /lib/systemd/system/binfmt-support.service. 2026-02-25T20:29:28.370 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libclang-cpp14 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:28.371 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libgc1:amd64 (1:8.0.6-1.1build1) ... 2026-02-25T20:29:28.372 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libgfortran5:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.373 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libubsan1:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.374 INFO:teuthology.orchestra.run.trial047.stdout:Setting up llvm-14-linker-tools (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:28.375 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libcc1-0:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.375 INFO:teuthology.orchestra.run.trial047.stdout:Setting up liblsan0:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.376 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libitm1:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.377 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libtsan0:amd64 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.378 INFO:teuthology.orchestra.run.trial047.stdout:Setting up llvm-14 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:28.379 INFO:teuthology.orchestra.run.trial047.stdout:Setting up llvm-14-tools (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:28.380 INFO:teuthology.orchestra.run.trial047.stdout:Setting up cpp-11 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.380 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libz3-dev:amd64 (4.8.12-1) ... 2026-02-25T20:29:28.381 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libobjc4:amd64 (12.3.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.382 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libgcc-11-dev:amd64 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.383 INFO:teuthology.orchestra.run.trial047.stdout:Setting up gcc-11 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.384 INFO:teuthology.orchestra.run.trial047.stdout:Setting up llvm-14-dev (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:28.385 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libgfortran-11-dev:amd64 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.386 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libobjc-11-dev:amd64 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.386 INFO:teuthology.orchestra.run.trial047.stdout:Setting up gfortran-11 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.387 INFO:teuthology.orchestra.run.trial047.stdout:Setting up libstdc++-11-dev:amd64 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.388 INFO:teuthology.orchestra.run.trial047.stdout:Setting up clang-14 (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:29:28.389 INFO:teuthology.orchestra.run.trial047.stdout:Setting up g++-11 (11.4.0-1ubuntu1~22.04.3) ... 2026-02-25T20:29:28.390 INFO:teuthology.orchestra.run.trial047.stdout:Setting up postgresql-server-dev-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:29:28.391 INFO:teuthology.orchestra.run.trial047.stdout:Setting up postgresql-server-dev-all:amd64 (238) ... 2026-02-25T20:29:28.392 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:29:28.485 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-25T20:29:29.532 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:29.533 INFO:teuthology.orchestra.run.trial047.stdout:Running kernel seems to be up-to-date. 2026-02-25T20:29:29.533 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:29.533 INFO:teuthology.orchestra.run.trial047.stdout:The processor microcode seems to be up-to-date. 2026-02-25T20:29:29.533 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:29.533 INFO:teuthology.orchestra.run.trial047.stdout:Services to be restarted: 2026-02-25T20:29:29.536 INFO:teuthology.orchestra.run.trial047.stdout: systemctl restart lttng-sessiond.service 2026-02-25T20:29:29.541 INFO:teuthology.orchestra.run.trial047.stdout: systemctl restart mysql.service 2026-02-25T20:29:29.546 INFO:teuthology.orchestra.run.trial047.stdout: systemctl restart ntp.service 2026-02-25T20:29:29.550 INFO:teuthology.orchestra.run.trial047.stdout: systemctl restart packagekit.service 2026-02-25T20:29:29.554 INFO:teuthology.orchestra.run.trial047.stdout: systemctl restart postgresql@14-main.service 2026-02-25T20:29:29.559 INFO:teuthology.orchestra.run.trial047.stdout: systemctl restart smartmontools.service 2026-02-25T20:29:29.559 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:29.559 INFO:teuthology.orchestra.run.trial047.stdout:No containers need to be restarted. 2026-02-25T20:29:29.559 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:29.559 INFO:teuthology.orchestra.run.trial047.stdout:No user sessions are running outdated binaries. 2026-02-25T20:29:29.559 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:29:29.559 INFO:teuthology.orchestra.run.trial047.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-25T20:29:30.188 INFO:teuthology.orchestra.run.trial047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-25T20:29:30.191 INFO:tasks.keystone:Setting up database for keystone... 2026-02-25T20:29:30.191 DEBUG:teuthology.orchestra.run.trial047:> sudo mysql --execute="CREATE USER 'keystone'@'localhost' IDENTIFIED BY 'SECRET';" 2026-02-25T20:29:30.253 DEBUG:teuthology.orchestra.run.trial047:> sudo mysql --execute="CREATE DATABASE keystone;" 2026-02-25T20:29:30.308 DEBUG:teuthology.orchestra.run.trial047:> sudo mysql --execute="GRANT ALL PRIVILEGES ON keystone.* TO 'keystone'@'localhost';" 2026-02-25T20:29:30.365 DEBUG:teuthology.orchestra.run.trial047:> sudo mysql --execute="FLUSH PRIVILEGES;" 2026-02-25T20:29:30.421 INFO:tasks.keystone:Setting up virtualenv for keystone... 2026-02-25T20:29:30.421 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && sed -i 's/usedevelop.*/usedevelop=false/g' tox.ini 2026-02-25T20:29:30.468 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-venv/bin/activate && tox -e venv --notest 2026-02-25T20:29:31.309 INFO:teuthology.orchestra.run.trial047.stdout:venv: install_deps> python -I -m pip install '.[ldap,memcache]' -r /home/ubuntu/cephtest/keystone/test-requirements.txt -c https://releases.openstack.org/constraints/upper/2024.2 2026-02-25T20:29:39.785 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:29:39.785 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:29:39.787 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:29:39.787 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:29:39.788 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:29:39.788 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:29:52.915 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: install_requires> python -I -m pip install 'setuptools>=40.8.0' 2026-02-25T20:29:53.279 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: _optional_hooks> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:29:53.494 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: get_requires_for_build_sdist> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:29:53.661 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: install_requires_for_build_sdist> python -I -m pip install 'pbr>=2.0.0' 2026-02-25T20:29:53.917 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: get_requires_for_build_wheel> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:29:54.084 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: install_requires_for_build_wheel> python -I -m pip install 'pbr>=2.0.0' 2026-02-25T20:29:54.265 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: prepare_metadata_for_build_wheel> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:29:54.841 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: build_sdist> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:29:56.314 INFO:teuthology.orchestra.run.trial047.stdout:venv: install_package_deps> python -I -m pip install 'Flask!=0.11,>=1.0.2' 'Flask-RESTful>=0.3.5' 'PyJWT>=1.6.1' 'SQLAlchemy>=1.4.0' 'WebOb>=1.7.1' 'bcrypt>=3.1.3' 'cryptography>=2.7' 'dogpile.cache>=1.0.2' 'jsonschema>=3.2.0' 'keystonemiddleware>=7.0.0' 'msgpack>=0.5.0' 'oauthlib>=0.6.2' 'oslo.cache>=1.26.0' 'oslo.config>=6.8.0' 'oslo.context>=2.22.0' 'oslo.db>=6.0.0' 'oslo.i18n>=3.15.3' 'oslo.log>=3.44.0' 'oslo.messaging>=5.29.0' 'oslo.middleware>=3.31.0' 'oslo.policy>=3.10.0' 'oslo.serialization!=2.19.1,>=2.18.0' 'oslo.upgradecheck>=1.3.0' 'oslo.utils>=3.33.0' 'osprofiler>=1.4.0' 'passlib>=1.7.0' 'pbr!=2.1.0,>=2.0.0' 'pycadf!=2.0.0,>=1.1.0' 'pysaml2>=5.0.0' 'python-keystoneclient>=3.8.0' 'scrypt>=0.8.0' 'stevedore>=1.20.0' 2026-02-25T20:29:56.668 INFO:teuthology.orchestra.run.trial047.stdout:venv: install_package> python -I -m pip install --force-reinstall --no-deps /home/ubuntu/cephtest/keystone/.tox/.tmp/package/1/keystone-26.1.0.tar.gz 2026-02-25T20:29:59.157 INFO:teuthology.orchestra.run.trial047.stdout: venv: OK (28.55 seconds) 2026-02-25T20:29:59.157 INFO:teuthology.orchestra.run.trial047.stdout: congratulations :) (28.57 seconds) 2026-02-25T20:29:59.175 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && pip install python-openstackclient==5.2.1 osc-lib==2.0.0 2026-02-25T20:29:59.417 INFO:teuthology.orchestra.run.trial047.stdout:Collecting python-openstackclient==5.2.1 2026-02-25T20:29:59.444 INFO:teuthology.orchestra.run.trial047.stdout: Downloading python_openstackclient-5.2.1-py3-none-any.whl.metadata (4.7 kB) 2026-02-25T20:29:59.454 INFO:teuthology.orchestra.run.trial047.stdout:Collecting osc-lib==2.0.0 2026-02-25T20:29:59.458 INFO:teuthology.orchestra.run.trial047.stdout: Downloading osc_lib-2.0.0-py2.py3-none-any.whl.metadata (3.4 kB) 2026-02-25T20:29:59.474 INFO:teuthology.orchestra.run.trial047.stdout:Collecting Babel!=2.4.0,>=2.3.4 (from python-openstackclient==5.2.1) 2026-02-25T20:29:59.480 INFO:teuthology.orchestra.run.trial047.stdout: Downloading babel-2.18.0-py3-none-any.whl.metadata (2.2 kB) 2026-02-25T20:29:59.482 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: cliff!=2.9.0,>=2.8.0 in ./.tox/venv/lib/python3.10/site-packages (from python-openstackclient==5.2.1) (4.7.0) 2026-02-25T20:29:59.497 INFO:teuthology.orchestra.run.trial047.stdout:Collecting openstacksdk>=0.36.0 (from python-openstackclient==5.2.1) 2026-02-25T20:29:59.501 INFO:teuthology.orchestra.run.trial047.stdout: Downloading openstacksdk-4.10.0-py3-none-any.whl.metadata (12 kB) 2026-02-25T20:29:59.504 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: oslo.i18n>=3.15.3 in ./.tox/venv/lib/python3.10/site-packages (from python-openstackclient==5.2.1) (6.4.0) 2026-02-25T20:29:59.504 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: oslo.utils>=3.33.0 in ./.tox/venv/lib/python3.10/site-packages (from python-openstackclient==5.2.1) (7.3.0) 2026-02-25T20:29:59.504 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: pbr!=2.1.0,>=2.0.0 in ./.tox/venv/lib/python3.10/site-packages (from python-openstackclient==5.2.1) (6.1.0) 2026-02-25T20:29:59.521 INFO:teuthology.orchestra.run.trial047.stdout:Collecting python-cinderclient>=3.3.0 (from python-openstackclient==5.2.1) 2026-02-25T20:29:59.526 INFO:teuthology.orchestra.run.trial047.stdout: Downloading python_cinderclient-9.8.0-py3-none-any.whl.metadata (18 kB) 2026-02-25T20:29:59.529 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: python-keystoneclient>=3.22.0 in ./.tox/venv/lib/python3.10/site-packages (from python-openstackclient==5.2.1) (5.5.0) 2026-02-25T20:29:59.542 INFO:teuthology.orchestra.run.trial047.stdout:Collecting python-novaclient>=15.1.0 (from python-openstackclient==5.2.1) 2026-02-25T20:29:59.548 INFO:teuthology.orchestra.run.trial047.stdout: Downloading python_novaclient-18.12.0-py3-none-any.whl.metadata (3.2 kB) 2026-02-25T20:29:59.549 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: six>=1.10.0 in ./.tox/venv/lib/python3.10/site-packages (from python-openstackclient==5.2.1) (1.16.0) 2026-02-25T20:29:59.550 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: keystoneauth1>=3.7.0 in ./.tox/venv/lib/python3.10/site-packages (from osc-lib==2.0.0) (5.8.1) 2026-02-25T20:29:59.591 INFO:teuthology.orchestra.run.trial047.stdout:Collecting simplejson>=3.5.1 (from osc-lib==2.0.0) 2026-02-25T20:29:59.596 INFO:teuthology.orchestra.run.trial047.stdout: Downloading simplejson-3.20.2-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.2 kB) 2026-02-25T20:29:59.597 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: stevedore>=1.20.0 in ./.tox/venv/lib/python3.10/site-packages (from osc-lib==2.0.0) (5.3.0) 2026-02-25T20:29:59.598 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: PrettyTable>=0.7.2 in ./.tox/venv/lib/python3.10/site-packages (from cliff!=2.9.0,>=2.8.0->python-openstackclient==5.2.1) (3.11.0) 2026-02-25T20:29:59.599 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: PyYAML>=3.12 in ./.tox/venv/lib/python3.10/site-packages (from cliff!=2.9.0,>=2.8.0->python-openstackclient==5.2.1) (6.0.2) 2026-02-25T20:29:59.599 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: autopage>=0.4.0 in ./.tox/venv/lib/python3.10/site-packages (from cliff!=2.9.0,>=2.8.0->python-openstackclient==5.2.1) (0.5.2) 2026-02-25T20:29:59.599 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: cmd2>=1.0.0 in ./.tox/venv/lib/python3.10/site-packages (from cliff!=2.9.0,>=2.8.0->python-openstackclient==5.2.1) (2.4.3) 2026-02-25T20:29:59.601 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: attrs>=16.3.0 in ./.tox/venv/lib/python3.10/site-packages (from cmd2>=1.0.0->cliff!=2.9.0,>=2.8.0->python-openstackclient==5.2.1) (24.2.0) 2026-02-25T20:29:59.601 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: pyperclip>=1.6 in ./.tox/venv/lib/python3.10/site-packages (from cmd2>=1.0.0->cliff!=2.9.0,>=2.8.0->python-openstackclient==5.2.1) (1.9.0) 2026-02-25T20:29:59.601 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: wcwidth>=0.1.7 in ./.tox/venv/lib/python3.10/site-packages (from cmd2>=1.0.0->cliff!=2.9.0,>=2.8.0->python-openstackclient==5.2.1) (0.2.13) 2026-02-25T20:29:59.606 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: iso8601>=0.1.11 in ./.tox/venv/lib/python3.10/site-packages (from keystoneauth1>=3.7.0->osc-lib==2.0.0) (2.1.0) 2026-02-25T20:29:59.607 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: requests>=2.14.2 in ./.tox/venv/lib/python3.10/site-packages (from keystoneauth1>=3.7.0->osc-lib==2.0.0) (2.32.3) 2026-02-25T20:29:59.607 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: os-service-types>=1.2.0 in ./.tox/venv/lib/python3.10/site-packages (from keystoneauth1>=3.7.0->osc-lib==2.0.0) (1.7.0) 2026-02-25T20:29:59.607 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: cryptography>=2.7 in ./.tox/venv/lib/python3.10/site-packages (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) (42.0.8) 2026-02-25T20:29:59.608 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: decorator>=4.4.1 in ./.tox/venv/lib/python3.10/site-packages (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) (5.1.1) 2026-02-25T20:29:59.608 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: dogpile.cache>=0.6.5 in ./.tox/venv/lib/python3.10/site-packages (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) (1.3.3) 2026-02-25T20:29:59.614 INFO:teuthology.orchestra.run.trial047.stdout:Collecting jmespath>=0.9.0 (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) 2026-02-25T20:29:59.618 INFO:teuthology.orchestra.run.trial047.stdout: Downloading jmespath-1.1.0-py3-none-any.whl.metadata (7.6 kB) 2026-02-25T20:29:59.626 INFO:teuthology.orchestra.run.trial047.stdout:Collecting jsonpatch!=1.20,>=1.16 (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) 2026-02-25T20:29:59.631 INFO:teuthology.orchestra.run.trial047.stdout: Downloading jsonpatch-1.33-py2.py3-none-any.whl.metadata (3.0 kB) 2026-02-25T20:29:59.643 INFO:teuthology.orchestra.run.trial047.stdout:Collecting keystoneauth1>=3.7.0 (from osc-lib==2.0.0) 2026-02-25T20:29:59.650 INFO:teuthology.orchestra.run.trial047.stdout: Downloading keystoneauth1-5.13.1-py3-none-any.whl.metadata (2.9 kB) 2026-02-25T20:29:59.661 INFO:teuthology.orchestra.run.trial047.stdout:Collecting os-service-types>=1.2.0 (from keystoneauth1>=3.7.0->osc-lib==2.0.0) 2026-02-25T20:29:59.665 INFO:teuthology.orchestra.run.trial047.stdout: Downloading os_service_types-1.8.2-py3-none-any.whl.metadata (1.9 kB) 2026-02-25T20:29:59.675 INFO:teuthology.orchestra.run.trial047.stdout:Collecting platformdirs>=3 (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) 2026-02-25T20:29:59.679 INFO:teuthology.orchestra.run.trial047.stdout: Downloading platformdirs-4.9.2-py3-none-any.whl.metadata (4.7 kB) 2026-02-25T20:29:59.714 INFO:teuthology.orchestra.run.trial047.stdout:Collecting psutil>=3.2.2 (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) 2026-02-25T20:29:59.718 INFO:teuthology.orchestra.run.trial047.stdout: Downloading psutil-7.2.2-cp36-abi3-manylinux2010_x86_64.manylinux_2_12_x86_64.manylinux_2_28_x86_64.whl.metadata (22 kB) 2026-02-25T20:29:59.742 INFO:teuthology.orchestra.run.trial047.stdout:Collecting requestsexceptions>=1.2.0 (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) 2026-02-25T20:29:59.746 INFO:teuthology.orchestra.run.trial047.stdout: Downloading requestsexceptions-1.4.0-py2.py3-none-any.whl.metadata (1.2 kB) 2026-02-25T20:29:59.747 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: typing-extensions>=4.12.0 in ./.tox/venv/lib/python3.10/site-packages (from openstacksdk>=0.36.0->python-openstackclient==5.2.1) (4.12.2) 2026-02-25T20:29:59.749 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: cffi>=1.12 in ./.tox/venv/lib/python3.10/site-packages (from cryptography>=2.7->openstacksdk>=0.36.0->python-openstackclient==5.2.1) (1.17.0) 2026-02-25T20:29:59.750 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: pycparser in ./.tox/venv/lib/python3.10/site-packages (from cffi>=1.12->cryptography>=2.7->openstacksdk>=0.36.0->python-openstackclient==5.2.1) (2.22) 2026-02-25T20:29:59.759 INFO:teuthology.orchestra.run.trial047.stdout:Collecting jsonpointer>=1.9 (from jsonpatch!=1.20,>=1.16->openstacksdk>=0.36.0->python-openstackclient==5.2.1) 2026-02-25T20:29:59.763 INFO:teuthology.orchestra.run.trial047.stdout: Downloading jsonpointer-3.0.0-py2.py3-none-any.whl.metadata (2.3 kB) 2026-02-25T20:29:59.767 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: debtcollector>=1.2.0 in ./.tox/venv/lib/python3.10/site-packages (from oslo.utils>=3.33.0->python-openstackclient==5.2.1) (3.0.0) 2026-02-25T20:29:59.768 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: netaddr>=0.10.0 in ./.tox/venv/lib/python3.10/site-packages (from oslo.utils>=3.33.0->python-openstackclient==5.2.1) (0.10.1) 2026-02-25T20:29:59.768 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: netifaces>=0.10.4 in ./.tox/venv/lib/python3.10/site-packages (from oslo.utils>=3.33.0->python-openstackclient==5.2.1) (0.11.0) 2026-02-25T20:29:59.768 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: packaging>=20.4 in ./.tox/venv/lib/python3.10/site-packages (from oslo.utils>=3.33.0->python-openstackclient==5.2.1) (24.1) 2026-02-25T20:29:59.768 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: pyparsing>=2.1.0 in ./.tox/venv/lib/python3.10/site-packages (from oslo.utils>=3.33.0->python-openstackclient==5.2.1) (3.1.2) 2026-02-25T20:29:59.768 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: tzdata>=2022.4 in ./.tox/venv/lib/python3.10/site-packages (from oslo.utils>=3.33.0->python-openstackclient==5.2.1) (2024.1) 2026-02-25T20:29:59.769 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: wrapt>=1.7.0 in ./.tox/venv/lib/python3.10/site-packages (from debtcollector>=1.2.0->oslo.utils>=3.33.0->python-openstackclient==5.2.1) (1.16.0) 2026-02-25T20:29:59.776 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: oslo.config>=5.2.0 in ./.tox/venv/lib/python3.10/site-packages (from python-keystoneclient>=3.22.0->python-openstackclient==5.2.1) (9.6.0) 2026-02-25T20:29:59.776 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: oslo.serialization>=2.18.0 in ./.tox/venv/lib/python3.10/site-packages (from python-keystoneclient>=3.22.0->python-openstackclient==5.2.1) (5.5.0) 2026-02-25T20:29:59.778 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: rfc3986>=1.2.0 in ./.tox/venv/lib/python3.10/site-packages (from oslo.config>=5.2.0->python-keystoneclient>=3.22.0->python-openstackclient==5.2.1) (2.0.0) 2026-02-25T20:29:59.779 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: msgpack>=0.5.2 in ./.tox/venv/lib/python3.10/site-packages (from oslo.serialization>=2.18.0->python-keystoneclient>=3.22.0->python-openstackclient==5.2.1) (1.0.8) 2026-02-25T20:29:59.783 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: charset-normalizer<4,>=2 in ./.tox/venv/lib/python3.10/site-packages (from requests>=2.14.2->keystoneauth1>=3.7.0->osc-lib==2.0.0) (3.3.2) 2026-02-25T20:29:59.783 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: idna<4,>=2.5 in ./.tox/venv/lib/python3.10/site-packages (from requests>=2.14.2->keystoneauth1>=3.7.0->osc-lib==2.0.0) (3.8) 2026-02-25T20:29:59.783 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: urllib3<3,>=1.21.1 in ./.tox/venv/lib/python3.10/site-packages (from requests>=2.14.2->keystoneauth1>=3.7.0->osc-lib==2.0.0) (1.26.19) 2026-02-25T20:29:59.784 INFO:teuthology.orchestra.run.trial047.stdout:Requirement already satisfied: certifi>=2017.4.17 in ./.tox/venv/lib/python3.10/site-packages (from requests>=2.14.2->keystoneauth1>=3.7.0->osc-lib==2.0.0) (2026.2.25) 2026-02-25T20:29:59.796 INFO:teuthology.orchestra.run.trial047.stdout:Downloading python_openstackclient-5.2.1-py3-none-any.whl (880 kB) 2026-02-25T20:29:59.809 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 880.4/880.4 kB 100.4 MB/s 0:00:00 2026-02-25T20:29:59.814 INFO:teuthology.orchestra.run.trial047.stdout:Downloading osc_lib-2.0.0-py2.py3-none-any.whl (89 kB) 2026-02-25T20:29:59.819 INFO:teuthology.orchestra.run.trial047.stdout:Downloading babel-2.18.0-py3-none-any.whl (10.2 MB) 2026-02-25T20:29:59.855 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.2/10.2 MB 292.7 MB/s 0:00:00 2026-02-25T20:29:59.860 INFO:teuthology.orchestra.run.trial047.stdout:Downloading openstacksdk-4.10.0-py3-none-any.whl (1.9 MB) 2026-02-25T20:29:59.868 INFO:teuthology.orchestra.run.trial047.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.9/1.9 MB 245.5 MB/s 0:00:00 2026-02-25T20:29:59.872 INFO:teuthology.orchestra.run.trial047.stdout:Downloading jmespath-1.1.0-py3-none-any.whl (20 kB) 2026-02-25T20:29:59.877 INFO:teuthology.orchestra.run.trial047.stdout:Downloading jsonpatch-1.33-py2.py3-none-any.whl (12 kB) 2026-02-25T20:29:59.882 INFO:teuthology.orchestra.run.trial047.stdout:Downloading jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) 2026-02-25T20:29:59.887 INFO:teuthology.orchestra.run.trial047.stdout:Downloading keystoneauth1-5.13.1-py3-none-any.whl (343 kB) 2026-02-25T20:29:59.894 INFO:teuthology.orchestra.run.trial047.stdout:Downloading os_service_types-1.8.2-py3-none-any.whl (24 kB) 2026-02-25T20:29:59.898 INFO:teuthology.orchestra.run.trial047.stdout:Downloading platformdirs-4.9.2-py3-none-any.whl (21 kB) 2026-02-25T20:29:59.903 INFO:teuthology.orchestra.run.trial047.stdout:Downloading psutil-7.2.2-cp36-abi3-manylinux2010_x86_64.manylinux_2_12_x86_64.manylinux_2_28_x86_64.whl (155 kB) 2026-02-25T20:29:59.909 INFO:teuthology.orchestra.run.trial047.stdout:Downloading python_cinderclient-9.8.0-py3-none-any.whl (256 kB) 2026-02-25T20:29:59.916 INFO:teuthology.orchestra.run.trial047.stdout:Downloading python_novaclient-18.12.0-py3-none-any.whl (336 kB) 2026-02-25T20:29:59.926 INFO:teuthology.orchestra.run.trial047.stdout:Downloading requestsexceptions-1.4.0-py2.py3-none-any.whl (3.8 kB) 2026-02-25T20:29:59.932 INFO:teuthology.orchestra.run.trial047.stdout:Downloading simplejson-3.20.2-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB) 2026-02-25T20:30:00.018 INFO:teuthology.orchestra.run.trial047.stdout:Installing collected packages: requestsexceptions, simplejson, psutil, platformdirs, os-service-types, jsonpointer, jmespath, Babel, keystoneauth1, jsonpatch, python-cinderclient, openstacksdk, python-novaclient, osc-lib, python-openstackclient 2026-02-25T20:30:00.078 INFO:teuthology.orchestra.run.trial047.stdout: Attempting uninstall: os-service-types 2026-02-25T20:30:00.079 INFO:teuthology.orchestra.run.trial047.stdout: Found existing installation: os-service-types 1.7.0 2026-02-25T20:30:00.080 INFO:teuthology.orchestra.run.trial047.stdout: Uninstalling os-service-types-1.7.0: 2026-02-25T20:30:00.080 INFO:teuthology.orchestra.run.trial047.stdout: Successfully uninstalled os-service-types-1.7.0 2026-02-25T20:30:00.280 INFO:teuthology.orchestra.run.trial047.stdout: Attempting uninstall: keystoneauth1 2026-02-25T20:30:00.281 INFO:teuthology.orchestra.run.trial047.stdout: Found existing installation: keystoneauth1 5.8.1 2026-02-25T20:30:00.288 INFO:teuthology.orchestra.run.trial047.stdout: Uninstalling keystoneauth1-5.8.1: 2026-02-25T20:30:00.289 INFO:teuthology.orchestra.run.trial047.stdout: Successfully uninstalled keystoneauth1-5.8.1 2026-02-25T20:30:01.336 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:30:01.343 INFO:teuthology.orchestra.run.trial047.stdout:Successfully installed Babel-2.18.0 jmespath-1.1.0 jsonpatch-1.33 jsonpointer-3.0.0 keystoneauth1-5.13.1 openstacksdk-4.10.0 os-service-types-1.8.2 osc-lib-2.0.0 platformdirs-4.9.2 psutil-7.2.2 python-cinderclient-9.8.0 python-novaclient-18.12.0 python-openstackclient-5.2.1 requestsexceptions-1.4.0 simplejson-3.20.2 2026-02-25T20:30:01.430 INFO:tasks.keystone:Configuring keystone... 2026-02-25T20:30:01.430 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-venv/bin/activate && tox -e genconfig 2026-02-25T20:30:02.105 INFO:teuthology.orchestra.run.trial047.stdout:genconfig: install_deps> python -I -m pip install '.[ldap,memcache]' -r /home/ubuntu/cephtest/keystone/test-requirements.txt -c https://releases.openstack.org/constraints/upper/2024.2 2026-02-25T20:30:09.786 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:30:09.786 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:30:09.789 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:30:09.789 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:30:09.790 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:30:09.790 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:30:12.800 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: _optional_hooks> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:30:12.965 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: get_requires_for_build_sdist> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:30:13.131 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: get_requires_for_build_wheel> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:30:13.298 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: prepare_metadata_for_build_wheel> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:30:14.118 INFO:teuthology.orchestra.run.trial047.stdout:.pkg: build_sdist> python /home/ubuntu/cephtest/tox-venv/lib/python3.10/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-02-25T20:30:15.848 INFO:teuthology.orchestra.run.trial047.stdout:genconfig: install_package_deps> python -I -m pip install 'Flask!=0.11,>=1.0.2' 'Flask-RESTful>=0.3.5' 'PyJWT>=1.6.1' 'SQLAlchemy>=1.4.0' 'WebOb>=1.7.1' 'bcrypt>=3.1.3' 'cryptography>=2.7' 'dogpile.cache>=1.0.2' 'jsonschema>=3.2.0' 'keystonemiddleware>=7.0.0' 'msgpack>=0.5.0' 'oauthlib>=0.6.2' 'oslo.cache>=1.26.0' 'oslo.config>=6.8.0' 'oslo.context>=2.22.0' 'oslo.db>=6.0.0' 'oslo.i18n>=3.15.3' 'oslo.log>=3.44.0' 'oslo.messaging>=5.29.0' 'oslo.middleware>=3.31.0' 'oslo.policy>=3.10.0' 'oslo.serialization!=2.19.1,>=2.18.0' 'oslo.upgradecheck>=1.3.0' 'oslo.utils>=3.33.0' 'osprofiler>=1.4.0' 'passlib>=1.7.0' 'pbr!=2.1.0,>=2.0.0' 'pycadf!=2.0.0,>=1.1.0' 'pysaml2>=5.0.0' 'python-keystoneclient>=3.8.0' 'scrypt>=0.8.0' 'stevedore>=1.20.0' 2026-02-25T20:30:16.205 INFO:teuthology.orchestra.run.trial047.stdout:genconfig: install_package> python -I -m pip install --force-reinstall --no-deps /home/ubuntu/cephtest/keystone/.tox/.tmp/package/2/keystone-26.1.0.tar.gz 2026-02-25T20:30:18.676 INFO:teuthology.orchestra.run.trial047.stdout:genconfig: commands[0]> oslo-config-generator --config-file=config-generator/keystone.conf 2026-02-25T20:30:18.958 INFO:teuthology.orchestra.run.trial047.stdout: genconfig: OK (17.43=setup[17.15]+cmd[0.28] seconds) 2026-02-25T20:30:18.958 INFO:teuthology.orchestra.run.trial047.stdout: congratulations :) (17.44 seconds) 2026-02-25T20:30:18.976 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && cp -f etc/keystone.conf.sample etc/keystone.conf 2026-02-25T20:30:18.982 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && sed -e 's^#key_repository =.*^key_repository = /home/ubuntu/cephtest/keystone/etc/fernet-keys^' -i etc/keystone.conf 2026-02-25T20:30:19.030 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && sed -e 's^#connection =.*^connection = mysql+pymysql://keystone:SECRET@localhost/keystone^' -i etc/keystone.conf 2026-02-25T20:30:19.078 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && sed -e 's^#log_file =.*^log_file = /home/ubuntu/cephtest/archive/keystone.client.0.log^' -i etc/keystone.conf 2026-02-25T20:30:19.126 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && cp etc/keystone.conf /home/ubuntu/cephtest/archive/keystone.client.0.conf 2026-02-25T20:30:19.173 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && mkdir -p /home/ubuntu/cephtest/keystone/etc/fernet-keys 2026-02-25T20:30:19.217 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && keystone-manage --config-file /home/ubuntu/cephtest/keystone/etc/keystone.conf fernet_setup 2026-02-25T20:30:20.000 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && keystone-manage --config-file /home/ubuntu/cephtest/keystone/etc/keystone.conf db_sync 2026-02-25T20:30:21.076 INFO:tasks.keystone:Configuring keystone... 2026-02-25T20:30:21.077 INFO:tasks.keystone.client.0:Restarting daemon 2026-02-25T20:30:21.077 DEBUG:teuthology.orchestra.run.trial047:> OS_KEYSTONE_CONFIG_FILES=/home/ubuntu/cephtest/keystone/etc/keystone.conf /home/ubuntu/cephtest/keystone/.tox/venv/bin/python /home/ubuntu/cephtest/keystone/.tox/venv/bin/keystone-wsgi-public --host trial047.front.sepia.ceph.com --port 5000 & { read; kill %1; } 2026-02-25T20:30:21.079 INFO:tasks.keystone.client.0:Started 2026-02-25T20:30:21.079 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && sleep 15 2026-02-25T20:30:21.690 INFO:tasks.keystone.client.0.trial047.stderr:Traceback (most recent call last): 2026-02-25T20:30:21.690 INFO:tasks.keystone.client.0.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/bin/keystone-wsgi-public", line 6, in 2026-02-25T20:30:21.690 INFO:tasks.keystone.client.0.trial047.stderr: from keystone.server.wsgi import initialize_public_application 2026-02-25T20:30:21.690 INFO:tasks.keystone.client.0.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.10/site-packages/keystone/server/wsgi.py", line 14, in 2026-02-25T20:30:21.690 INFO:tasks.keystone.client.0.trial047.stderr: from keystone.server.flask import core as flask_core 2026-02-25T20:30:21.690 INFO:tasks.keystone.client.0.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.10/site-packages/keystone/server/flask/core.py", line 30, in 2026-02-25T20:30:21.691 INFO:tasks.keystone.client.0.trial047.stderr: from keystone.server.flask.request_processing.middleware import auth_context 2026-02-25T20:30:21.691 INFO:tasks.keystone.client.0.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.10/site-packages/keystone/server/flask/request_processing/middleware/auth_context.py", line 19, in 2026-02-25T20:30:21.691 INFO:tasks.keystone.client.0.trial047.stderr: from keystonemiddleware import auth_token 2026-02-25T20:30:21.691 INFO:tasks.keystone.client.0.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.10/site-packages/keystonemiddleware/auth_token/__init__.py", line 235, in 2026-02-25T20:30:21.691 INFO:tasks.keystone.client.0.trial047.stderr: from keystonemiddleware._common import config 2026-02-25T20:30:21.691 INFO:tasks.keystone.client.0.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.10/site-packages/keystonemiddleware/_common/config.py", line 13, in 2026-02-25T20:30:21.691 INFO:tasks.keystone.client.0.trial047.stderr: import pkg_resources 2026-02-25T20:30:21.691 INFO:tasks.keystone.client.0.trial047.stderr:ModuleNotFoundError: No module named 'pkg_resources' 2026-02-25T20:30:36.087 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && keystone-manage --config-file /home/ubuntu/cephtest/keystone/etc/keystone.conf bootstrap --bootstrap-password ADMIN --bootstrap-region-id RegionOne --bootstrap-internal-url http://trial047.front.sepia.ceph.com:5000/v3 --bootstrap-admin-url http://trial047.front.sepia.ceph.com:5000/v3 --bootstrap-public-url http://trial047.front.sepia.ceph.com:5000/v3 2026-02-25T20:30:37.251 DEBUG:teuthology.orchestra.run.trial047:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack project create --or-show --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://trial047.front.sepia.ceph.com:5000/v3 --description 's3tests project' s3tests --debug 2026-02-25T20:30:37.428 INFO:teuthology.orchestra.run.trial047.stderr:Traceback (most recent call last): 2026-02-25T20:30:37.428 INFO:teuthology.orchestra.run.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/bin/openstack", line 3, in 2026-02-25T20:30:37.428 INFO:teuthology.orchestra.run.trial047.stderr: from openstackclient.shell import main 2026-02-25T20:30:37.428 INFO:teuthology.orchestra.run.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.10/site-packages/openstackclient/shell.py", line 23, in 2026-02-25T20:30:37.428 INFO:teuthology.orchestra.run.trial047.stderr: from osc_lib.command import commandmanager 2026-02-25T20:30:37.428 INFO:teuthology.orchestra.run.trial047.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.10/site-packages/osc_lib/command/commandmanager.py", line 18, in 2026-02-25T20:30:37.428 INFO:teuthology.orchestra.run.trial047.stderr: import pkg_resources 2026-02-25T20:30:37.428 INFO:teuthology.orchestra.run.trial047.stderr:ModuleNotFoundError: No module named 'pkg_resources' 2026-02-25T20:30:37.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T20:30:37.449 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 388, in fill_keystone run_section_cmds(ctx, cclient, 'project create --or-show', 'name', File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 348, in run_section_cmds run_in_keystone_venv(ctx, cclient, File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 41, in run_in_keystone_venv return run_in_keystone_dir(ctx, client, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 28, in run_in_keystone_dir return ctx.cluster.only(client).run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial047 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack project create --or-show --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://trial047.front.sepia.ceph.com:5000/v3 --description 's3tests project' s3tests --debug" 2026-02-25T20:30:37.452 INFO:tasks.keystone:Stopping Keystone public instance 2026-02-25T20:30:37.452 DEBUG:tasks.keystone.client.0:waiting for process to exit 2026-02-25T20:30:37.452 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T20:30:37.453 INFO:tasks.keystone.client.0:Stopped 2026-02-25T20:30:37.453 INFO:tasks.keystone:Removing packaged dependencies of Keystone... 2026-02-25T20:30:37.453 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge libffi-dev 2026-02-25T20:30:37.525 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:37.639 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:37.639 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:37.729 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:37.730 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:30:37.730 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpfm4 libpmemobj1 libpq-dev 2026-02-25T20:30:37.730 INFO:teuthology.orchestra.run.trial047.stdout: libsgutils2-2 libz3-4 libz3-dev linux-headers-5.15.0-164 2026-02-25T20:30:37.730 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164-generic linux-image-5.15.0-164-generic 2026-02-25T20:30:37.730 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-164-generic linux-modules-extra-5.15.0-164-generic 2026-02-25T20:30:37.730 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14 llvm-14-runtime llvm-14-tools sg3-utils sg3-utils-udev 2026-02-25T20:30:37.730 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:37.737 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:37.737 INFO:teuthology.orchestra.run.trial047.stdout: libffi-dev* llvm-14-dev* postgresql-server-dev-14* 2026-02-25T20:30:37.737 INFO:teuthology.orchestra.run.trial047.stdout: postgresql-server-dev-all* 2026-02-25T20:30:37.892 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 4 to remove and 10 not upgraded. 2026-02-25T20:30:37.892 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 285 MB disk space will be freed. 2026-02-25T20:30:37.947 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 218334 files and directories currently installed.) 2026-02-25T20:30:37.950 INFO:teuthology.orchestra.run.trial047.stdout:Removing postgresql-server-dev-all:amd64 (238) ... 2026-02-25T20:30:37.958 INFO:teuthology.orchestra.run.trial047.stdout:Removing postgresql-server-dev-14 (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:30:37.983 INFO:teuthology.orchestra.run.trial047.stdout:Removing llvm-14-dev (1:14.0.0-1ubuntu1.1) ... 2026-02-25T20:30:38.058 INFO:teuthology.orchestra.run.trial047.stdout:Removing libffi-dev:amd64 (3.4.2-4) ... 2026-02-25T20:30:38.078 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:30:38.129 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-25T20:30:38.197 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-25T20:30:38.965 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge libldap2-dev 2026-02-25T20:30:39.039 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:39.150 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:39.150 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:39.238 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:39.238 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:30:39.239 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libldap-dev libpfm4 libpmemobj1 libpq-dev 2026-02-25T20:30:39.239 INFO:teuthology.orchestra.run.trial047.stdout: libsgutils2-2 libz3-4 libz3-dev linux-headers-5.15.0-164 2026-02-25T20:30:39.239 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164-generic linux-image-5.15.0-164-generic 2026-02-25T20:30:39.239 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-164-generic linux-modules-extra-5.15.0-164-generic 2026-02-25T20:30:39.239 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14 llvm-14-runtime llvm-14-tools sg3-utils sg3-utils-udev 2026-02-25T20:30:39.239 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:39.245 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:39.245 INFO:teuthology.orchestra.run.trial047.stdout: libldap2-dev* 2026-02-25T20:30:39.399 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 1 to remove and 10 not upgraded. 2026-02-25T20:30:39.399 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 99.3 kB disk space will be freed. 2026-02-25T20:30:39.454 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 215321 files and directories currently installed.) 2026-02-25T20:30:39.457 INFO:teuthology.orchestra.run.trial047.stdout:Removing libldap2-dev (2.5.20+dfsg-0ubuntu0.22.04.1) ... 2026-02-25T20:30:39.787 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:30:39.787 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:30:39.789 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:30:39.790 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:30:39.791 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:30:39.791 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:30:40.230 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge libsasl2-dev 2026-02-25T20:30:40.312 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:40.425 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:40.425 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:40.514 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:40.514 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:30:40.514 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libldap-dev libpfm4 libpmemobj1 libpq-dev 2026-02-25T20:30:40.514 INFO:teuthology.orchestra.run.trial047.stdout: libsgutils2-2 libz3-4 libz3-dev linux-headers-5.15.0-164 2026-02-25T20:30:40.514 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164-generic linux-image-5.15.0-164-generic 2026-02-25T20:30:40.514 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-164-generic linux-modules-extra-5.15.0-164-generic 2026-02-25T20:30:40.514 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14 llvm-14-runtime llvm-14-tools sg3-utils sg3-utils-udev 2026-02-25T20:30:40.515 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:40.521 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:40.521 INFO:teuthology.orchestra.run.trial047.stdout: libsasl2-dev* 2026-02-25T20:30:40.664 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 1 to remove and 10 not upgraded. 2026-02-25T20:30:40.664 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 916 kB disk space will be freed. 2026-02-25T20:30:40.719 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 215318 files and directories currently installed.) 2026-02-25T20:30:40.722 INFO:teuthology.orchestra.run.trial047.stdout:Removing libsasl2-dev (2.1.27+dfsg2-3ubuntu1.2) ... 2026-02-25T20:30:40.743 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:30:41.550 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge libsqlite3-dev 2026-02-25T20:30:41.627 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:41.736 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:41.737 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:41.824 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:41.824 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:30:41.824 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libldap-dev libpfm4 libpmemobj1 libpq-dev 2026-02-25T20:30:41.824 INFO:teuthology.orchestra.run.trial047.stdout: libsgutils2-2 libz3-4 libz3-dev linux-headers-5.15.0-164 2026-02-25T20:30:41.824 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164-generic linux-image-5.15.0-164-generic 2026-02-25T20:30:41.824 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-164-generic linux-modules-extra-5.15.0-164-generic 2026-02-25T20:30:41.824 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14 llvm-14-runtime llvm-14-tools sg3-utils sg3-utils-udev 2026-02-25T20:30:41.824 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:41.831 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:41.831 INFO:teuthology.orchestra.run.trial047.stdout: libsqlite3-dev* 2026-02-25T20:30:41.980 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 1 to remove and 10 not upgraded. 2026-02-25T20:30:41.980 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 3167 kB disk space will be freed. 2026-02-25T20:30:42.041 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 215251 files and directories currently installed.) 2026-02-25T20:30:42.044 INFO:teuthology.orchestra.run.trial047.stdout:Removing libsqlite3-dev:amd64 (3.37.2-2ubuntu0.5) ... 2026-02-25T20:30:42.832 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge libssl-dev 2026-02-25T20:30:42.907 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:43.023 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:43.024 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:43.113 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:43.113 INFO:teuthology.orchestra.run.trial047.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-25T20:30:43.113 INFO:teuthology.orchestra.run.trial047.stdout: libgfxdr0 libglusterfs0 libiscsi7 libldap-dev libpfm4 libpmemobj1 2026-02-25T20:30:43.113 INFO:teuthology.orchestra.run.trial047.stdout: libsgutils2-2 libz3-4 libz3-dev linux-headers-5.15.0-164 2026-02-25T20:30:43.113 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164-generic linux-image-5.15.0-164-generic 2026-02-25T20:30:43.113 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-164-generic linux-modules-extra-5.15.0-164-generic 2026-02-25T20:30:43.113 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14 llvm-14-runtime llvm-14-tools sg3-utils sg3-utils-udev 2026-02-25T20:30:43.114 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:43.120 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:43.121 INFO:teuthology.orchestra.run.trial047.stdout: libpq-dev* libssl-dev* 2026-02-25T20:30:43.276 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 2 to remove and 10 not upgraded. 2026-02-25T20:30:43.276 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 13.0 MB disk space will be freed. 2026-02-25T20:30:43.330 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 215243 files and directories currently installed.) 2026-02-25T20:30:43.333 INFO:teuthology.orchestra.run.trial047.stdout:Removing libpq-dev (14.20-0ubuntu0.22.04.1) ... 2026-02-25T20:30:43.341 INFO:teuthology.orchestra.run.trial047.stdout:Removing libssl-dev:amd64 (3.0.2-0ubuntu1.21) ... 2026-02-25T20:30:43.365 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:30:44.186 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge libxml2-dev 2026-02-25T20:30:44.263 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:44.373 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:44.374 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:44.463 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:44.463 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 2026-02-25T20:30:44.463 INFO:teuthology.orchestra.run.trial047.stdout: libgfrpc0 libgfxdr0 libglusterfs0 libicu-dev libiscsi7 libldap-dev libpfm4 2026-02-25T20:30:44.463 INFO:teuthology.orchestra.run.trial047.stdout: libpmemobj1 libsgutils2-2 libz3-4 libz3-dev linux-headers-5.15.0-164 2026-02-25T20:30:44.464 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164-generic linux-image-5.15.0-164-generic 2026-02-25T20:30:44.464 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-164-generic linux-modules-extra-5.15.0-164-generic 2026-02-25T20:30:44.464 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14 llvm-14-runtime llvm-14-tools sg3-utils sg3-utils-udev 2026-02-25T20:30:44.464 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:44.469 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:44.469 INFO:teuthology.orchestra.run.trial047.stdout: libxml2-dev* libxslt1-dev* 2026-02-25T20:30:44.614 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 2 to remove and 10 not upgraded. 2026-02-25T20:30:44.614 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 5478 kB disk space will be freed. 2026-02-25T20:30:44.666 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 215070 files and directories currently installed.) 2026-02-25T20:30:44.669 INFO:teuthology.orchestra.run.trial047.stdout:Removing libxslt1-dev:amd64 (1.1.34-4ubuntu0.22.04.5) ... 2026-02-25T20:30:44.680 INFO:teuthology.orchestra.run.trial047.stdout:Removing libxml2-dev:amd64 (2.9.13+dfsg-1ubuntu0.11) ... 2026-02-25T20:30:44.700 INFO:teuthology.orchestra.run.trial047.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-25T20:30:45.510 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge libxslt1-dev 2026-02-25T20:30:45.584 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:45.695 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:45.695 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout:Package 'libxslt1-dev' is not installed, so not removed 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout: libgfrpc0 libgfxdr0 libglusterfs0 libicu-dev libiscsi7 libldap-dev libpfm4 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout: libpmemobj1 libsgutils2-2 libz3-4 libz3-dev linux-headers-5.15.0-164 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164-generic linux-image-5.15.0-164-generic 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-164-generic linux-modules-extra-5.15.0-164-generic 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14 llvm-14-runtime llvm-14-tools sg3-utils sg3-utils-udev 2026-02-25T20:30:45.785 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:45.797 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2026-02-25T20:30:45.800 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge mysql-client 2026-02-25T20:30:45.876 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:45.992 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:45.992 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:46.083 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:46.083 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 2026-02-25T20:30:46.083 INFO:teuthology.orchestra.run.trial047.stdout: libgfrpc0 libgfxdr0 libglusterfs0 libicu-dev libiscsi7 libldap-dev libpfm4 2026-02-25T20:30:46.083 INFO:teuthology.orchestra.run.trial047.stdout: libpmemobj1 libsgutils2-2 libz3-4 libz3-dev linux-headers-5.15.0-164 2026-02-25T20:30:46.083 INFO:teuthology.orchestra.run.trial047.stdout: linux-headers-5.15.0-164-generic linux-image-5.15.0-164-generic 2026-02-25T20:30:46.083 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-5.15.0-164-generic linux-modules-extra-5.15.0-164-generic 2026-02-25T20:30:46.083 INFO:teuthology.orchestra.run.trial047.stdout: llvm-14 llvm-14-runtime llvm-14-tools sg3-utils sg3-utils-udev 2026-02-25T20:30:46.083 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:46.090 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:46.091 INFO:teuthology.orchestra.run.trial047.stdout: mysql-client* 2026-02-25T20:30:46.245 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 1 to remove and 10 not upgraded. 2026-02-25T20:30:46.245 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 35.8 kB disk space will be freed. 2026-02-25T20:30:46.299 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 214868 files and directories currently installed.) 2026-02-25T20:30:46.301 INFO:teuthology.orchestra.run.trial047.stdout:Removing mysql-client (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:30:47.087 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge mysql-server 2026-02-25T20:30:47.164 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:47.274 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:47.275 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:47.361 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:47.361 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 2026-02-25T20:30:47.361 INFO:teuthology.orchestra.run.trial047.stdout: libcgi-fast-perl libcgi-pm-perl libfcgi-perl libgfapi0 libgfrpc0 libgfxdr0 2026-02-25T20:30:47.361 INFO:teuthology.orchestra.run.trial047.stdout: libglusterfs0 libhtml-template-perl libicu-dev libiscsi7 libldap-dev 2026-02-25T20:30:47.361 INFO:teuthology.orchestra.run.trial047.stdout: libmecab2 libpfm4 libpmemobj1 libprotobuf-lite23 libsgutils2-2 libz3-4 2026-02-25T20:30:47.361 INFO:teuthology.orchestra.run.trial047.stdout: libz3-dev linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:30:47.362 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:30:47.362 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic llvm-14 llvm-14-runtime llvm-14-tools 2026-02-25T20:30:47.362 INFO:teuthology.orchestra.run.trial047.stdout: mecab-ipadic mecab-ipadic-utf8 mecab-utils mysql-client-8.0 2026-02-25T20:30:47.362 INFO:teuthology.orchestra.run.trial047.stdout: mysql-client-core-8.0 mysql-common mysql-server-8.0 mysql-server-core-8.0 2026-02-25T20:30:47.362 INFO:teuthology.orchestra.run.trial047.stdout: sg3-utils sg3-utils-udev 2026-02-25T20:30:47.362 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:47.368 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:47.368 INFO:teuthology.orchestra.run.trial047.stdout: mysql-server* 2026-02-25T20:30:47.513 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 1 to remove and 10 not upgraded. 2026-02-25T20:30:47.513 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 35.8 kB disk space will be freed. 2026-02-25T20:30:47.567 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 214866 files and directories currently installed.) 2026-02-25T20:30:47.570 INFO:teuthology.orchestra.run.trial047.stdout:Removing mysql-server (8.0.45-0ubuntu0.22.04.1) ... 2026-02-25T20:30:48.358 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge postgresql 2026-02-25T20:30:48.435 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:48.548 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:48.549 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout: libcgi-fast-perl libcgi-pm-perl libfcgi-perl libgfapi0 libgfrpc0 libgfxdr0 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout: libglusterfs0 libhtml-template-perl libicu-dev libiscsi7 libldap-dev 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout: libmecab2 libpfm4 libpmemobj1 libprotobuf-lite23 libsgutils2-2 libz3-4 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout: libz3-dev linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic llvm-14 llvm-14-runtime llvm-14-tools 2026-02-25T20:30:48.638 INFO:teuthology.orchestra.run.trial047.stdout: mecab-ipadic mecab-ipadic-utf8 mecab-utils mysql-client-8.0 2026-02-25T20:30:48.639 INFO:teuthology.orchestra.run.trial047.stdout: mysql-client-core-8.0 mysql-common mysql-server-8.0 mysql-server-core-8.0 2026-02-25T20:30:48.639 INFO:teuthology.orchestra.run.trial047.stdout: sg3-utils sg3-utils-udev 2026-02-25T20:30:48.639 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:48.645 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:48.645 INFO:teuthology.orchestra.run.trial047.stdout: postgresql* 2026-02-25T20:30:48.791 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 1 to remove and 10 not upgraded. 2026-02-25T20:30:48.791 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 71.7 kB disk space will be freed. 2026-02-25T20:30:48.852 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 214864 files and directories currently installed.) 2026-02-25T20:30:48.855 INFO:teuthology.orchestra.run.trial047.stdout:Removing postgresql (14+238) ... 2026-02-25T20:30:49.651 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge postgresql-client 2026-02-25T20:30:49.727 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:49.842 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:49.843 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: libcgi-fast-perl libcgi-pm-perl libfcgi-perl libgfapi0 libgfrpc0 libgfxdr0 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: libglusterfs0 libhtml-template-perl libicu-dev libiscsi7 libldap-dev 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: libmecab2 libpfm4 libpmemobj1 libprotobuf-lite23 libsgutils2-2 libz3-4 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: libz3-dev linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic llvm-14 llvm-14-runtime llvm-14-tools 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: mecab-ipadic mecab-ipadic-utf8 mecab-utils mysql-client-8.0 2026-02-25T20:30:49.935 INFO:teuthology.orchestra.run.trial047.stdout: mysql-client-core-8.0 mysql-common mysql-server-8.0 mysql-server-core-8.0 2026-02-25T20:30:49.936 INFO:teuthology.orchestra.run.trial047.stdout: sg3-utils sg3-utils-udev 2026-02-25T20:30:49.936 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:49.942 INFO:teuthology.orchestra.run.trial047.stdout:The following packages will be REMOVED: 2026-02-25T20:30:49.942 INFO:teuthology.orchestra.run.trial047.stdout: postgresql-client* 2026-02-25T20:30:50.088 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 1 to remove and 10 not upgraded. 2026-02-25T20:30:50.088 INFO:teuthology.orchestra.run.trial047.stdout:After this operation, 71.7 kB disk space will be freed. 2026-02-25T20:30:50.147 INFO:teuthology.orchestra.run.trial047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 214861 files and directories currently installed.) 2026-02-25T20:30:50.150 INFO:teuthology.orchestra.run.trial047.stdout:Removing postgresql-client (14+238) ... 2026-02-25T20:30:50.908 DEBUG:teuthology.orchestra.run.trial047:> DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y purge postgresql-server-dev-all 2026-02-25T20:30:50.984 INFO:teuthology.orchestra.run.trial047.stdout:Reading package lists... 2026-02-25T20:30:51.093 INFO:teuthology.orchestra.run.trial047.stdout:Building dependency tree... 2026-02-25T20:30:51.094 INFO:teuthology.orchestra.run.trial047.stdout:Reading state information... 2026-02-25T20:30:51.180 INFO:teuthology.orchestra.run.trial047.stdout:Package 'postgresql-server-dev-all' is not installed, so not removed 2026-02-25T20:30:51.180 INFO:teuthology.orchestra.run.trial047.stdout:The following packages were automatically installed and are no longer required: 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: icu-devtools kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: libcgi-fast-perl libcgi-pm-perl libfcgi-perl libgfapi0 libgfrpc0 libgfxdr0 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: libglusterfs0 libhtml-template-perl libicu-dev libiscsi7 libldap-dev 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: libmecab2 libpfm4 libpmemobj1 libprotobuf-lite23 libsgutils2-2 libz3-4 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: libz3-dev linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: linux-modules-extra-5.15.0-164-generic llvm-14 llvm-14-runtime llvm-14-tools 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: mecab-ipadic mecab-ipadic-utf8 mecab-utils mysql-client-8.0 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: mysql-client-core-8.0 mysql-common mysql-server-8.0 mysql-server-core-8.0 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout: sg3-utils sg3-utils-udev 2026-02-25T20:30:51.181 INFO:teuthology.orchestra.run.trial047.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-25T20:30:51.192 INFO:teuthology.orchestra.run.trial047.stdout:0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2026-02-25T20:30:51.194 INFO:tasks.keystone:Removing keystone... 2026-02-25T20:30:51.195 DEBUG:teuthology.orchestra.run.trial047:> rm -rf /home/ubuntu/cephtest/keystone 2026-02-25T20:30:51.951 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 506, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 388, in fill_keystone run_section_cmds(ctx, cclient, 'project create --or-show', 'name', File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 348, in run_section_cmds run_in_keystone_venv(ctx, cclient, File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 41, in run_in_keystone_venv return run_in_keystone_dir(ctx, client, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_ceph-c_80c7315e5866ead938d7771844a338858c6ed0e3/qa/tasks/keystone.py", line 28, in run_in_keystone_dir return ctx.cluster.only(client).run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial047 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack project create --or-show --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://trial047.front.sepia.ceph.com:5000/v3 --description 's3tests project' s3tests --debug" 2026-02-25T20:30:51.954 DEBUG:teuthology.run_tasks:Unwinding manager keystone 2026-02-25T20:30:51.967 DEBUG:teuthology.run_tasks:Unwinding manager tox 2026-02-25T20:30:51.982 DEBUG:teuthology.orchestra.run.trial047:> rm -rf /home/ubuntu/cephtest/tox-venv 2026-02-25T20:30:52.029 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-25T20:30:52.043 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T20:30:52.044 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T20:30:52.202 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:30:52.202 INFO:teuthology.orchestra.run.trial047.stderr:dumped all 2026-02-25T20:30:52.213 INFO:teuthology.orchestra.run.trial047.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2026-02-25T20:30:51.789043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82456,"kb_used_data":1576,"kb_used_omap":24,"kb_used_meta":80807,"kb_avail":314490344,"statfs":{"total":322122547200,"available":322038112256,"internally_reserved":0,"allocated":1613824,"data_stored":1302886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24606,"internal_metadata":82747362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001492"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806224+0000","last_change":"2026-02-25T20:28:20.198029+0000","last_active":"2026-02-25T20:28:24.806224+0000","last_peered":"2026-02-25T20:28:24.806224+0000","last_clean":"2026-02-25T20:28:24.806224+0000","last_became_active":"2026-02-25T20:28:18.195850+0000","last_became_peered":"2026-02-25T20:28:18.195850+0000","last_unstale":"2026-02-25T20:28:24.806224+0000","last_undegraded":"2026-02-25T20:28:24.806224+0000","last_fullsized":"2026-02-25T20:28:24.806224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:08:22.756739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043050400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806175+0000","last_change":"2026-02-25T20:28:20.198199+0000","last_active":"2026-02-25T20:28:24.806175+0000","last_peered":"2026-02-25T20:28:24.806175+0000","last_clean":"2026-02-25T20:28:24.806175+0000","last_became_active":"2026-02-25T20:28:18.195879+0000","last_became_peered":"2026-02-25T20:28:18.195879+0000","last_unstale":"2026-02-25T20:28:24.806175+0000","last_undegraded":"2026-02-25T20:28:24.806175+0000","last_fullsized":"2026-02-25T20:28:24.806175+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:14:54.537699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053849200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806203+0000","last_change":"2026-02-25T20:28:20.198377+0000","last_active":"2026-02-25T20:28:24.806203+0000","last_peered":"2026-02-25T20:28:24.806203+0000","last_clean":"2026-02-25T20:28:24.806203+0000","last_became_active":"2026-02-25T20:28:18.195896+0000","last_became_peered":"2026-02-25T20:28:18.195896+0000","last_unstale":"2026-02-25T20:28:24.806203+0000","last_undegraded":"2026-02-25T20:28:24.806203+0000","last_fullsized":"2026-02-25T20:28:24.806203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:20.955416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065946600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806192+0000","last_change":"2026-02-25T20:28:20.198068+0000","last_active":"2026-02-25T20:28:24.806192+0000","last_peered":"2026-02-25T20:28:24.806192+0000","last_clean":"2026-02-25T20:28:24.806192+0000","last_became_active":"2026-02-25T20:28:18.195675+0000","last_became_peered":"2026-02-25T20:28:18.195675+0000","last_unstale":"2026-02-25T20:28:24.806192+0000","last_undegraded":"2026-02-25T20:28:24.806192+0000","last_fullsized":"2026-02-25T20:28:24.806192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:38:33.920162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045795599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":25,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:23.808367+0000","last_change":"2026-02-25T20:28:20.196168+0000","last_active":"2026-02-25T20:28:23.808367+0000","last_peered":"2026-02-25T20:28:23.808367+0000","last_clean":"2026-02-25T20:28:23.808367+0000","last_became_active":"2026-02-25T20:28:18.195435+0000","last_became_peered":"2026-02-25T20:28:18.195435+0000","last_unstale":"2026-02-25T20:28:23.808367+0000","last_undegraded":"2026-02-25T20:28:23.808367+0000","last_fullsized":"2026-02-25T20:28:23.808367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:39:44.856036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028753600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806137+0000","last_change":"2026-02-25T20:28:20.551205+0000","last_active":"2026-02-25T20:28:24.806137+0000","last_peered":"2026-02-25T20:28:24.806137+0000","last_clean":"2026-02-25T20:28:24.806137+0000","last_became_active":"2026-02-25T20:28:18.195942+0000","last_became_peered":"2026-02-25T20:28:18.195942+0000","last_unstale":"2026-02-25T20:28:24.806137+0000","last_undegraded":"2026-02-25T20:28:24.806137+0000","last_fullsized":"2026-02-25T20:28:24.806137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:56:19.382854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000349336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806137+0000","last_change":"2026-02-25T20:28:20.551165+0000","last_active":"2026-02-25T20:28:24.806137+0000","last_peered":"2026-02-25T20:28:24.806137+0000","last_clean":"2026-02-25T20:28:24.806137+0000","last_became_active":"2026-02-25T20:28:18.195414+0000","last_became_peered":"2026-02-25T20:28:18.195414+0000","last_unstale":"2026-02-25T20:28:24.806137+0000","last_undegraded":"2026-02-25T20:28:24.806137+0000","last_fullsized":"2026-02-25T20:28:24.806137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:13:02.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032044000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":24,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806151+0000","last_change":"2026-02-25T20:28:20.198236+0000","last_active":"2026-02-25T20:28:24.806151+0000","last_peered":"2026-02-25T20:28:24.806151+0000","last_clean":"2026-02-25T20:28:24.806151+0000","last_became_active":"2026-02-25T20:28:18.194940+0000","last_became_peered":"2026-02-25T20:28:18.194940+0000","last_unstale":"2026-02-25T20:28:24.806151+0000","last_undegraded":"2026-02-25T20:28:24.806151+0000","last_fullsized":"2026-02-25T20:28:24.806151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:25:43.293805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053638799999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'72","reported_seq":24,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806159+0000","last_change":"2026-02-25T20:28:18.200227+0000","last_active":"2026-02-25T20:28:24.806159+0000","last_peered":"2026-02-25T20:28:24.806159+0000","last_clean":"2026-02-25T20:28:24.806159+0000","last_became_active":"2026-02-25T20:28:18.194757+0000","last_became_peered":"2026-02-25T20:28:18.194757+0000","last_unstale":"2026-02-25T20:28:24.806159+0000","last_undegraded":"2026-02-25T20:28:24.806159+0000","last_fullsized":"2026-02-25T20:28:24.806159+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_clean_scrub_stamp":"2026-02-25T20:28:14.088080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:11:10.120605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640293,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7552,"internal_metadata":27583104},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27096,"kb_used_data":136,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104830504,"statfs":{"total":107374182400,"available":107346436096,"internally_reserved":0,"allocated":139264,"data_stored":40704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8202,"internal_metadata":27582454},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8852,"internal_metadata":27581804},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T20:30:52.214 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T20:30:52.371 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:30:52.372 INFO:teuthology.orchestra.run.trial047.stderr:dumped all 2026-02-25T20:30:52.382 INFO:teuthology.orchestra.run.trial047.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2026-02-25T20:30:51.789043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82456,"kb_used_data":1576,"kb_used_omap":24,"kb_used_meta":80807,"kb_avail":314490344,"statfs":{"total":322122547200,"available":322038112256,"internally_reserved":0,"allocated":1613824,"data_stored":1302886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24606,"internal_metadata":82747362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001492"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806224+0000","last_change":"2026-02-25T20:28:20.198029+0000","last_active":"2026-02-25T20:28:24.806224+0000","last_peered":"2026-02-25T20:28:24.806224+0000","last_clean":"2026-02-25T20:28:24.806224+0000","last_became_active":"2026-02-25T20:28:18.195850+0000","last_became_peered":"2026-02-25T20:28:18.195850+0000","last_unstale":"2026-02-25T20:28:24.806224+0000","last_undegraded":"2026-02-25T20:28:24.806224+0000","last_fullsized":"2026-02-25T20:28:24.806224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:08:22.756739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043050400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806175+0000","last_change":"2026-02-25T20:28:20.198199+0000","last_active":"2026-02-25T20:28:24.806175+0000","last_peered":"2026-02-25T20:28:24.806175+0000","last_clean":"2026-02-25T20:28:24.806175+0000","last_became_active":"2026-02-25T20:28:18.195879+0000","last_became_peered":"2026-02-25T20:28:18.195879+0000","last_unstale":"2026-02-25T20:28:24.806175+0000","last_undegraded":"2026-02-25T20:28:24.806175+0000","last_fullsized":"2026-02-25T20:28:24.806175+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:14:54.537699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053849200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806203+0000","last_change":"2026-02-25T20:28:20.198377+0000","last_active":"2026-02-25T20:28:24.806203+0000","last_peered":"2026-02-25T20:28:24.806203+0000","last_clean":"2026-02-25T20:28:24.806203+0000","last_became_active":"2026-02-25T20:28:18.195896+0000","last_became_peered":"2026-02-25T20:28:18.195896+0000","last_unstale":"2026-02-25T20:28:24.806203+0000","last_undegraded":"2026-02-25T20:28:24.806203+0000","last_fullsized":"2026-02-25T20:28:24.806203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:20.955416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065946600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806192+0000","last_change":"2026-02-25T20:28:20.198068+0000","last_active":"2026-02-25T20:28:24.806192+0000","last_peered":"2026-02-25T20:28:24.806192+0000","last_clean":"2026-02-25T20:28:24.806192+0000","last_became_active":"2026-02-25T20:28:18.195675+0000","last_became_peered":"2026-02-25T20:28:18.195675+0000","last_unstale":"2026-02-25T20:28:24.806192+0000","last_undegraded":"2026-02-25T20:28:24.806192+0000","last_fullsized":"2026-02-25T20:28:24.806192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:38:33.920162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045795599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":25,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:23.808367+0000","last_change":"2026-02-25T20:28:20.196168+0000","last_active":"2026-02-25T20:28:23.808367+0000","last_peered":"2026-02-25T20:28:23.808367+0000","last_clean":"2026-02-25T20:28:23.808367+0000","last_became_active":"2026-02-25T20:28:18.195435+0000","last_became_peered":"2026-02-25T20:28:18.195435+0000","last_unstale":"2026-02-25T20:28:23.808367+0000","last_undegraded":"2026-02-25T20:28:23.808367+0000","last_fullsized":"2026-02-25T20:28:23.808367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:39:44.856036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028753600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806137+0000","last_change":"2026-02-25T20:28:20.551205+0000","last_active":"2026-02-25T20:28:24.806137+0000","last_peered":"2026-02-25T20:28:24.806137+0000","last_clean":"2026-02-25T20:28:24.806137+0000","last_became_active":"2026-02-25T20:28:18.195942+0000","last_became_peered":"2026-02-25T20:28:18.195942+0000","last_unstale":"2026-02-25T20:28:24.806137+0000","last_undegraded":"2026-02-25T20:28:24.806137+0000","last_fullsized":"2026-02-25T20:28:24.806137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:56:19.382854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000349336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806137+0000","last_change":"2026-02-25T20:28:20.551165+0000","last_active":"2026-02-25T20:28:24.806137+0000","last_peered":"2026-02-25T20:28:24.806137+0000","last_clean":"2026-02-25T20:28:24.806137+0000","last_became_active":"2026-02-25T20:28:18.195414+0000","last_became_peered":"2026-02-25T20:28:18.195414+0000","last_unstale":"2026-02-25T20:28:24.806137+0000","last_undegraded":"2026-02-25T20:28:24.806137+0000","last_fullsized":"2026-02-25T20:28:24.806137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:13:02.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032044000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":24,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806151+0000","last_change":"2026-02-25T20:28:20.198236+0000","last_active":"2026-02-25T20:28:24.806151+0000","last_peered":"2026-02-25T20:28:24.806151+0000","last_clean":"2026-02-25T20:28:24.806151+0000","last_became_active":"2026-02-25T20:28:18.194940+0000","last_became_peered":"2026-02-25T20:28:18.194940+0000","last_unstale":"2026-02-25T20:28:24.806151+0000","last_undegraded":"2026-02-25T20:28:24.806151+0000","last_fullsized":"2026-02-25T20:28:24.806151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:25:43.293805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053638799999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'72","reported_seq":24,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806159+0000","last_change":"2026-02-25T20:28:18.200227+0000","last_active":"2026-02-25T20:28:24.806159+0000","last_peered":"2026-02-25T20:28:24.806159+0000","last_clean":"2026-02-25T20:28:24.806159+0000","last_became_active":"2026-02-25T20:28:18.194757+0000","last_became_peered":"2026-02-25T20:28:18.194757+0000","last_unstale":"2026-02-25T20:28:24.806159+0000","last_undegraded":"2026-02-25T20:28:24.806159+0000","last_fullsized":"2026-02-25T20:28:24.806159+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_clean_scrub_stamp":"2026-02-25T20:28:14.088080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:11:10.120605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640293,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7552,"internal_metadata":27583104},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27096,"kb_used_data":136,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104830504,"statfs":{"total":107374182400,"available":107346436096,"internally_reserved":0,"allocated":139264,"data_stored":40704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8202,"internal_metadata":27582454},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8852,"internal_metadata":27581804},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T20:30:52.383 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T20:30:52.384 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T20:30:52.543 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:30:52.543 INFO:teuthology.orchestra.run.trial047.stderr:dumped all 2026-02-25T20:30:52.555 INFO:teuthology.orchestra.run.trial047.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2026-02-25T20:30:51.789043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82456,"kb_used_data":1576,"kb_used_omap":24,"kb_used_meta":80807,"kb_avail":314490344,"statfs":{"total":322122547200,"available":322038112256,"internally_reserved":0,"allocated":1613824,"data_stored":1302886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24606,"internal_metadata":82747362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001492"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806224+0000","last_change":"2026-02-25T20:28:20.198029+0000","last_active":"2026-02-25T20:28:24.806224+0000","last_peered":"2026-02-25T20:28:24.806224+0000","last_clean":"2026-02-25T20:28:24.806224+0000","last_became_active":"2026-02-25T20:28:18.195850+0000","last_became_peered":"2026-02-25T20:28:18.195850+0000","last_unstale":"2026-02-25T20:28:24.806224+0000","last_undegraded":"2026-02-25T20:28:24.806224+0000","last_fullsized":"2026-02-25T20:28:24.806224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:08:22.756739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043050400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806175+0000","last_change":"2026-02-25T20:28:20.198199+0000","last_active":"2026-02-25T20:28:24.806175+0000","last_peered":"2026-02-25T20:28:24.806175+0000","last_clean":"2026-02-25T20:28:24.806175+0000","last_became_active":"2026-02-25T20:28:18.195879+0000","last_became_peered":"2026-02-25T20:28:18.195879+0000","last_unstale":"2026-02-25T20:28:24.806175+0000","last_undegraded":"2026-02-25T20:28:24.806175+0000","last_fullsized":"2026-02-25T20:28:24.806175+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:14:54.537699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053849200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806203+0000","last_change":"2026-02-25T20:28:20.198377+0000","last_active":"2026-02-25T20:28:24.806203+0000","last_peered":"2026-02-25T20:28:24.806203+0000","last_clean":"2026-02-25T20:28:24.806203+0000","last_became_active":"2026-02-25T20:28:18.195896+0000","last_became_peered":"2026-02-25T20:28:18.195896+0000","last_unstale":"2026-02-25T20:28:24.806203+0000","last_undegraded":"2026-02-25T20:28:24.806203+0000","last_fullsized":"2026-02-25T20:28:24.806203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:20.955416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065946600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806192+0000","last_change":"2026-02-25T20:28:20.198068+0000","last_active":"2026-02-25T20:28:24.806192+0000","last_peered":"2026-02-25T20:28:24.806192+0000","last_clean":"2026-02-25T20:28:24.806192+0000","last_became_active":"2026-02-25T20:28:18.195675+0000","last_became_peered":"2026-02-25T20:28:18.195675+0000","last_unstale":"2026-02-25T20:28:24.806192+0000","last_undegraded":"2026-02-25T20:28:24.806192+0000","last_fullsized":"2026-02-25T20:28:24.806192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:38:33.920162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045795599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":25,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:23.808367+0000","last_change":"2026-02-25T20:28:20.196168+0000","last_active":"2026-02-25T20:28:23.808367+0000","last_peered":"2026-02-25T20:28:23.808367+0000","last_clean":"2026-02-25T20:28:23.808367+0000","last_became_active":"2026-02-25T20:28:18.195435+0000","last_became_peered":"2026-02-25T20:28:18.195435+0000","last_unstale":"2026-02-25T20:28:23.808367+0000","last_undegraded":"2026-02-25T20:28:23.808367+0000","last_fullsized":"2026-02-25T20:28:23.808367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:39:44.856036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028753600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806137+0000","last_change":"2026-02-25T20:28:20.551205+0000","last_active":"2026-02-25T20:28:24.806137+0000","last_peered":"2026-02-25T20:28:24.806137+0000","last_clean":"2026-02-25T20:28:24.806137+0000","last_became_active":"2026-02-25T20:28:18.195942+0000","last_became_peered":"2026-02-25T20:28:18.195942+0000","last_unstale":"2026-02-25T20:28:24.806137+0000","last_undegraded":"2026-02-25T20:28:24.806137+0000","last_fullsized":"2026-02-25T20:28:24.806137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:56:19.382854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000349336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806137+0000","last_change":"2026-02-25T20:28:20.551165+0000","last_active":"2026-02-25T20:28:24.806137+0000","last_peered":"2026-02-25T20:28:24.806137+0000","last_clean":"2026-02-25T20:28:24.806137+0000","last_became_active":"2026-02-25T20:28:18.195414+0000","last_became_peered":"2026-02-25T20:28:18.195414+0000","last_unstale":"2026-02-25T20:28:24.806137+0000","last_undegraded":"2026-02-25T20:28:24.806137+0000","last_fullsized":"2026-02-25T20:28:24.806137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:13:02.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032044000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":24,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806151+0000","last_change":"2026-02-25T20:28:20.198236+0000","last_active":"2026-02-25T20:28:24.806151+0000","last_peered":"2026-02-25T20:28:24.806151+0000","last_clean":"2026-02-25T20:28:24.806151+0000","last_became_active":"2026-02-25T20:28:18.194940+0000","last_became_peered":"2026-02-25T20:28:18.194940+0000","last_unstale":"2026-02-25T20:28:24.806151+0000","last_undegraded":"2026-02-25T20:28:24.806151+0000","last_fullsized":"2026-02-25T20:28:24.806151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:25:43.293805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053638799999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'72","reported_seq":24,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806159+0000","last_change":"2026-02-25T20:28:18.200227+0000","last_active":"2026-02-25T20:28:24.806159+0000","last_peered":"2026-02-25T20:28:24.806159+0000","last_clean":"2026-02-25T20:28:24.806159+0000","last_became_active":"2026-02-25T20:28:18.194757+0000","last_became_peered":"2026-02-25T20:28:18.194757+0000","last_unstale":"2026-02-25T20:28:24.806159+0000","last_undegraded":"2026-02-25T20:28:24.806159+0000","last_fullsized":"2026-02-25T20:28:24.806159+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_clean_scrub_stamp":"2026-02-25T20:28:14.088080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:11:10.120605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640293,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7552,"internal_metadata":27583104},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27096,"kb_used_data":136,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104830504,"statfs":{"total":107374182400,"available":107346436096,"internally_reserved":0,"allocated":139264,"data_stored":40704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8202,"internal_metadata":27582454},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8852,"internal_metadata":27581804},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T20:30:52.557 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T20:30:52.719 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:30:52.719 INFO:teuthology.orchestra.run.trial047.stdout:{"epoch":16,"fsid":"190d2ba5-842c-4712-a4c4-beed0d7d0fd9","created":"2026-02-25T20:28:08.854968+0000","modified":"2026-02-25T20:28:23.806756+0000","last_up_change":"2026-02-25T20:28:16.089044+0000","last_in_change":"2026-02-25T20:28:09.461436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T20:28:13.801114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T20:28:16.605664+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded3f6dc-33b9-477a-a63e-93006c465084","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6810","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6811","nonce":3432499718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6812","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6813","nonce":3432499718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6816","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6817","nonce":3432499718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6814","nonce":3432499718},{"type":"v1","addr":"10.20.193.47:6815","nonce":3432499718}]},"public_addr":"10.20.193.47:6811/3432499718","cluster_addr":"10.20.193.47:6813/3432499718","heartbeat_back_addr":"10.20.193.47:6817/3432499718","heartbeat_front_addr":"10.20.193.47:6815/3432499718","state":["exists","up"]},{"osd":1,"uuid":"7699b91f-4589-432f-afdc-b6eabcc064ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6818","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6819","nonce":653838958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6820","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6821","nonce":653838958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6824","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6825","nonce":653838958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6822","nonce":653838958},{"type":"v1","addr":"10.20.193.47:6823","nonce":653838958}]},"public_addr":"10.20.193.47:6819/653838958","cluster_addr":"10.20.193.47:6821/653838958","heartbeat_back_addr":"10.20.193.47:6825/653838958","heartbeat_front_addr":"10.20.193.47:6823/653838958","state":["exists","up"]},{"osd":2,"uuid":"89bae13a-5285-484a-a28b-ede7f3252546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6802","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6803","nonce":2941176462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6804","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6805","nonce":2941176462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6808","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6809","nonce":2941176462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.47:6806","nonce":2941176462},{"type":"v1","addr":"10.20.193.47:6807","nonce":2941176462}]},"public_addr":"10.20.193.47:6803/2941176462","cluster_addr":"10.20.193.47:6805/2941176462","heartbeat_back_addr":"10.20.193.47:6809/2941176462","heartbeat_front_addr":"10.20.193.47:6807/2941176462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.716264+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.752673+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T20:28:11.664493+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T20:30:53.731 INFO:tasks.ceph:Scrubbing osd.0 2026-02-25T20:30:53.731 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-25T20:30:53.808 INFO:teuthology.orchestra.run.trial047.stdout:{ 2026-02-25T20:30:53.809 INFO:teuthology.orchestra.run.trial047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T20:30:53.809 INFO:teuthology.orchestra.run.trial047.stdout:} 2026-02-25T20:30:53.818 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-25T20:30:53.973 INFO:teuthology.orchestra.run.trial047.stderr:instructed osd(s) 0 to deep-scrub 2026-02-25T20:30:53.985 INFO:tasks.ceph:Scrubbing osd.1 2026-02-25T20:30:53.985 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-25T20:30:54.068 INFO:teuthology.orchestra.run.trial047.stdout:{ 2026-02-25T20:30:54.068 INFO:teuthology.orchestra.run.trial047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-25T20:30:54.069 INFO:teuthology.orchestra.run.trial047.stdout:} 2026-02-25T20:30:54.081 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-25T20:30:54.242 INFO:teuthology.orchestra.run.trial047.stderr:instructed osd(s) 1 to deep-scrub 2026-02-25T20:30:54.253 INFO:tasks.ceph:Scrubbing osd.2 2026-02-25T20:30:54.254 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-25T20:30:54.336 INFO:teuthology.orchestra.run.trial047.stdout:{ 2026-02-25T20:30:54.336 INFO:teuthology.orchestra.run.trial047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T20:30:54.336 INFO:teuthology.orchestra.run.trial047.stdout:} 2026-02-25T20:30:54.345 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-25T20:30:54.504 INFO:teuthology.orchestra.run.trial047.stderr:instructed osd(s) 2 to deep-scrub 2026-02-25T20:30:54.516 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T20:30:54.678 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:30:54.679 INFO:teuthology.orchestra.run.trial047.stderr:dumped all 2026-02-25T20:30:54.691 INFO:teuthology.orchestra.run.trial047.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2026-02-25T20:30:53.789280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82456,"kb_used_data":1576,"kb_used_omap":24,"kb_used_meta":80807,"kb_avail":314490344,"statfs":{"total":322122547200,"available":322038112256,"internally_reserved":0,"allocated":1613824,"data_stored":1302886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24606,"internal_metadata":82747362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001479"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806224+0000","last_change":"2026-02-25T20:28:20.198029+0000","last_active":"2026-02-25T20:28:24.806224+0000","last_peered":"2026-02-25T20:28:24.806224+0000","last_clean":"2026-02-25T20:28:24.806224+0000","last_became_active":"2026-02-25T20:28:18.195850+0000","last_became_peered":"2026-02-25T20:28:18.195850+0000","last_unstale":"2026-02-25T20:28:24.806224+0000","last_undegraded":"2026-02-25T20:28:24.806224+0000","last_fullsized":"2026-02-25T20:28:24.806224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:08:22.756739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043050400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806175+0000","last_change":"2026-02-25T20:28:20.198199+0000","last_active":"2026-02-25T20:28:24.806175+0000","last_peered":"2026-02-25T20:28:24.806175+0000","last_clean":"2026-02-25T20:28:24.806175+0000","last_became_active":"2026-02-25T20:28:18.195879+0000","last_became_peered":"2026-02-25T20:28:18.195879+0000","last_unstale":"2026-02-25T20:28:24.806175+0000","last_undegraded":"2026-02-25T20:28:24.806175+0000","last_fullsized":"2026-02-25T20:28:24.806175+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:14:54.537699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053849200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806203+0000","last_change":"2026-02-25T20:28:20.198377+0000","last_active":"2026-02-25T20:28:24.806203+0000","last_peered":"2026-02-25T20:28:24.806203+0000","last_clean":"2026-02-25T20:28:24.806203+0000","last_became_active":"2026-02-25T20:28:18.195896+0000","last_became_peered":"2026-02-25T20:28:18.195896+0000","last_unstale":"2026-02-25T20:28:24.806203+0000","last_undegraded":"2026-02-25T20:28:24.806203+0000","last_fullsized":"2026-02-25T20:28:24.806203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:20.955416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065946600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806192+0000","last_change":"2026-02-25T20:28:20.198068+0000","last_active":"2026-02-25T20:28:24.806192+0000","last_peered":"2026-02-25T20:28:24.806192+0000","last_clean":"2026-02-25T20:28:24.806192+0000","last_became_active":"2026-02-25T20:28:18.195675+0000","last_became_peered":"2026-02-25T20:28:18.195675+0000","last_unstale":"2026-02-25T20:28:24.806192+0000","last_undegraded":"2026-02-25T20:28:24.806192+0000","last_fullsized":"2026-02-25T20:28:24.806192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:38:33.920162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045795599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":25,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:23.808367+0000","last_change":"2026-02-25T20:28:20.196168+0000","last_active":"2026-02-25T20:28:23.808367+0000","last_peered":"2026-02-25T20:28:23.808367+0000","last_clean":"2026-02-25T20:28:23.808367+0000","last_became_active":"2026-02-25T20:28:18.195435+0000","last_became_peered":"2026-02-25T20:28:18.195435+0000","last_unstale":"2026-02-25T20:28:23.808367+0000","last_undegraded":"2026-02-25T20:28:23.808367+0000","last_fullsized":"2026-02-25T20:28:23.808367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:39:44.856036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028753600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806137+0000","last_change":"2026-02-25T20:28:20.551205+0000","last_active":"2026-02-25T20:28:24.806137+0000","last_peered":"2026-02-25T20:28:24.806137+0000","last_clean":"2026-02-25T20:28:24.806137+0000","last_became_active":"2026-02-25T20:28:18.195942+0000","last_became_peered":"2026-02-25T20:28:18.195942+0000","last_unstale":"2026-02-25T20:28:24.806137+0000","last_undegraded":"2026-02-25T20:28:24.806137+0000","last_fullsized":"2026-02-25T20:28:24.806137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:56:19.382854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000349336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806137+0000","last_change":"2026-02-25T20:28:20.551165+0000","last_active":"2026-02-25T20:28:24.806137+0000","last_peered":"2026-02-25T20:28:24.806137+0000","last_clean":"2026-02-25T20:28:24.806137+0000","last_became_active":"2026-02-25T20:28:18.195414+0000","last_became_peered":"2026-02-25T20:28:18.195414+0000","last_unstale":"2026-02-25T20:28:24.806137+0000","last_undegraded":"2026-02-25T20:28:24.806137+0000","last_fullsized":"2026-02-25T20:28:24.806137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:13:02.471779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032044000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":24,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806151+0000","last_change":"2026-02-25T20:28:20.198236+0000","last_active":"2026-02-25T20:28:24.806151+0000","last_peered":"2026-02-25T20:28:24.806151+0000","last_clean":"2026-02-25T20:28:24.806151+0000","last_became_active":"2026-02-25T20:28:18.194940+0000","last_became_peered":"2026-02-25T20:28:18.194940+0000","last_unstale":"2026-02-25T20:28:24.806151+0000","last_undegraded":"2026-02-25T20:28:24.806151+0000","last_fullsized":"2026-02-25T20:28:24.806151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:17.188618+0000","last_clean_scrub_stamp":"2026-02-25T20:28:17.188618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:25:43.293805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053638799999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'72","reported_seq":24,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:28:24.806159+0000","last_change":"2026-02-25T20:28:18.200227+0000","last_active":"2026-02-25T20:28:24.806159+0000","last_peered":"2026-02-25T20:28:24.806159+0000","last_clean":"2026-02-25T20:28:24.806159+0000","last_became_active":"2026-02-25T20:28:18.194757+0000","last_became_peered":"2026-02-25T20:28:18.194757+0000","last_unstale":"2026-02-25T20:28:24.806159+0000","last_undegraded":"2026-02-25T20:28:24.806159+0000","last_fullsized":"2026-02-25T20:28:24.806159+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:28:14.088080+0000","last_clean_scrub_stamp":"2026-02-25T20:28:14.088080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:11:10.120605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640294,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7552,"internal_metadata":27583104},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27096,"kb_used_data":136,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104830504,"statfs":{"total":107374182400,"available":107346436096,"internally_reserved":0,"allocated":139264,"data_stored":40704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8202,"internal_metadata":27582454},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8852,"internal_metadata":27581804},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T20:30:54.697 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-25T20:28:17.188618+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.698 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-25T20:28:17.188618+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.698 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-25T20:28:17.188618+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.698 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-25T20:28:17.188618+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.698 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-25T20:28:17.188618+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.698 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-25T20:28:17.188618+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.699 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-25T20:28:17.188618+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.699 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-25T20:28:17.188618+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=17, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.699 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-25T20:28:14.088080+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=28, tm_sec=14, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=20, tm_min=30, tm_sec=52, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T20:30:54.699 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-25T20:31:09.789 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:31:09.789 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:31:09.790 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:31:09.791 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:31:09.791 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-25T20:31:09.792 INFO:tasks.ceph.mgr.x.trial047.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-25T20:31:14.700 DEBUG:teuthology.orchestra.run.trial047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T20:31:14.855 INFO:teuthology.orchestra.run.trial047.stdout: 2026-02-25T20:31:14.856 INFO:teuthology.orchestra.run.trial047.stderr:dumped all 2026-02-25T20:31:14.866 INFO:teuthology.orchestra.run.trial047.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2026-02-25T20:31:13.791215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82456,"kb_used_data":1576,"kb_used_omap":24,"kb_used_meta":80807,"kb_avail":314490344,"statfs":{"total":322122547200,"available":322038112256,"internally_reserved":0,"allocated":1613824,"data_stored":1302886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24606,"internal_metadata":82747362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001099"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:58.660062+0000","last_change":"2026-02-25T20:30:58.660062+0000","last_active":"2026-02-25T20:30:58.660062+0000","last_peered":"2026-02-25T20:30:58.660062+0000","last_clean":"2026-02-25T20:30:58.660062+0000","last_became_active":"2026-02-25T20:28:18.195850+0000","last_became_peered":"2026-02-25T20:28:18.195850+0000","last_unstale":"2026-02-25T20:30:58.660062+0000","last_undegraded":"2026-02-25T20:30:58.660062+0000","last_fullsized":"2026-02-25T20:30:58.660062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:30:58.660025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:30:58.660025+0000","last_clean_scrub_stamp":"2026-02-25T20:30:58.660025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:22:08.276626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043050400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:57.677791+0000","last_change":"2026-02-25T20:30:57.677791+0000","last_active":"2026-02-25T20:30:57.677791+0000","last_peered":"2026-02-25T20:30:57.677791+0000","last_clean":"2026-02-25T20:30:57.677791+0000","last_became_active":"2026-02-25T20:28:18.195879+0000","last_became_peered":"2026-02-25T20:28:18.195879+0000","last_unstale":"2026-02-25T20:30:57.677791+0000","last_undegraded":"2026-02-25T20:30:57.677791+0000","last_fullsized":"2026-02-25T20:30:57.677791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:30:57.677735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:30:57.677735+0000","last_clean_scrub_stamp":"2026-02-25T20:30:57.677735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:27:55.446277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053849200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:56.656119+0000","last_change":"2026-02-25T20:30:56.656119+0000","last_active":"2026-02-25T20:30:56.656119+0000","last_peered":"2026-02-25T20:30:56.656119+0000","last_clean":"2026-02-25T20:30:56.656119+0000","last_became_active":"2026-02-25T20:28:18.195896+0000","last_became_peered":"2026-02-25T20:28:18.195896+0000","last_unstale":"2026-02-25T20:30:56.656119+0000","last_undegraded":"2026-02-25T20:30:56.656119+0000","last_fullsized":"2026-02-25T20:30:56.656119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:30:56.656083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:30:56.656083+0000","last_clean_scrub_stamp":"2026-02-25T20:30:56.656083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:25:58.811156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065946600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:59.709568+0000","last_change":"2026-02-25T20:30:59.709568+0000","last_active":"2026-02-25T20:30:59.709568+0000","last_peered":"2026-02-25T20:30:59.709568+0000","last_clean":"2026-02-25T20:30:59.709568+0000","last_became_active":"2026-02-25T20:28:18.195675+0000","last_became_peered":"2026-02-25T20:28:18.195675+0000","last_unstale":"2026-02-25T20:30:59.709568+0000","last_undegraded":"2026-02-25T20:30:59.709568+0000","last_fullsized":"2026-02-25T20:30:59.709568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:30:59.709525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:30:59.709525+0000","last_clean_scrub_stamp":"2026-02-25T20:30:59.709525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:51:10.128435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045795599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'3","reported_seq":34,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:54.826275+0000","last_change":"2026-02-25T20:30:54.826275+0000","last_active":"2026-02-25T20:30:54.826275+0000","last_peered":"2026-02-25T20:30:54.826275+0000","last_clean":"2026-02-25T20:30:54.826275+0000","last_became_active":"2026-02-25T20:28:18.195435+0000","last_became_peered":"2026-02-25T20:28:18.195435+0000","last_unstale":"2026-02-25T20:30:54.826275+0000","last_undegraded":"2026-02-25T20:30:54.826275+0000","last_fullsized":"2026-02-25T20:30:54.826275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'3","last_scrub_stamp":"2026-02-25T20:30:54.826244+0000","last_deep_scrub":"16'3","last_deep_scrub_stamp":"2026-02-25T20:30:54.826244+0000","last_clean_scrub_stamp":"2026-02-25T20:30:54.826244+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:59:51.014536+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00028753600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:54.817302+0000","last_change":"2026-02-25T20:30:54.817302+0000","last_active":"2026-02-25T20:30:54.817302+0000","last_peered":"2026-02-25T20:30:54.817302+0000","last_clean":"2026-02-25T20:30:54.817302+0000","last_became_active":"2026-02-25T20:28:18.195942+0000","last_became_peered":"2026-02-25T20:28:18.195942+0000","last_unstale":"2026-02-25T20:30:54.817302+0000","last_undegraded":"2026-02-25T20:30:54.817302+0000","last_fullsized":"2026-02-25T20:30:54.817302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:30:54.817255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:30:54.817255+0000","last_clean_scrub_stamp":"2026-02-25T20:30:54.817255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:03:49.073159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000349336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:55.845598+0000","last_change":"2026-02-25T20:30:55.845598+0000","last_active":"2026-02-25T20:30:55.845598+0000","last_peered":"2026-02-25T20:30:55.845598+0000","last_clean":"2026-02-25T20:30:55.845598+0000","last_became_active":"2026-02-25T20:28:18.195414+0000","last_became_peered":"2026-02-25T20:28:18.195414+0000","last_unstale":"2026-02-25T20:30:55.845598+0000","last_undegraded":"2026-02-25T20:30:55.845598+0000","last_fullsized":"2026-02-25T20:30:55.845598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T20:30:55.845541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T20:30:55.845541+0000","last_clean_scrub_stamp":"2026-02-25T20:30:55.845541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:45:32.461618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032044000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"16'2","reported_seq":33,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:55.697141+0000","last_change":"2026-02-25T20:30:55.697141+0000","last_active":"2026-02-25T20:30:55.697141+0000","last_peered":"2026-02-25T20:30:55.697141+0000","last_clean":"2026-02-25T20:30:55.697141+0000","last_became_active":"2026-02-25T20:28:18.194940+0000","last_became_peered":"2026-02-25T20:28:18.194940+0000","last_unstale":"2026-02-25T20:30:55.697141+0000","last_undegraded":"2026-02-25T20:30:55.697141+0000","last_fullsized":"2026-02-25T20:30:55.697141+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2026-02-25T20:30:55.697106+0000","last_deep_scrub":"16'2","last_deep_scrub_stamp":"2026-02-25T20:30:55.697106+0000","last_clean_scrub_stamp":"2026-02-25T20:30:55.697106+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:36:49.242521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053638799999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'74","reported_seq":34,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-25T20:30:54.653452+0000","last_change":"2026-02-25T20:30:54.653452+0000","last_active":"2026-02-25T20:30:54.653452+0000","last_peered":"2026-02-25T20:30:54.653452+0000","last_clean":"2026-02-25T20:30:54.653452+0000","last_became_active":"2026-02-25T20:28:18.194757+0000","last_became_peered":"2026-02-25T20:28:18.194757+0000","last_unstale":"2026-02-25T20:30:54.653452+0000","last_undegraded":"2026-02-25T20:30:54.653452+0000","last_fullsized":"2026-02-25T20:30:54.653452+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'74","last_scrub_stamp":"2026-02-25T20:30:54.653417+0000","last_deep_scrub":"16'74","last_deep_scrub_stamp":"2026-02-25T20:30:54.653417+0000","last_clean_scrub_stamp":"2026-02-25T20:30:54.653417+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T07:25:53.404006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640298,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7552,"internal_metadata":27583104},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27096,"kb_used_data":136,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104830504,"statfs":{"total":107374182400,"available":107346436096,"internally_reserved":0,"allocated":139264,"data_stored":40704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8202,"internal_metadata":27582454},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27680,"kb_used_data":720,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":104829920,"statfs":{"total":107374182400,"available":107345838080,"internally_reserved":0,"allocated":737280,"data_stored":631091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8852,"internal_metadata":27581804},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T20:31:14.868 DEBUG:teuthology.orchestra.run.trial047:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-25T20:31:15.035 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-25T20:31:15.035 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-25T20:31:15.035 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-25T20:31:15.035 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T20:31:15.127 INFO:tasks.ceph.osd.0:Stopped 2026-02-25T20:31:15.128 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-25T20:31:15.128 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T20:31:15.191 INFO:tasks.ceph.osd.1:Stopped 2026-02-25T20:31:15.192 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-25T20:31:15.192 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T20:31:15.279 INFO:tasks.ceph.osd.2:Stopped 2026-02-25T20:31:15.279 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-25T20:31:15.280 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-25T20:31:15.280 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T20:31:15.299 INFO:tasks.ceph.mgr.x:Stopped 2026-02-25T20:31:15.299 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-25T20:31:15.299 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-25T20:31:15.299 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T20:31:15.358 INFO:tasks.ceph.mon.a:Stopped 2026-02-25T20:31:15.359 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-25T20:31:15.359 DEBUG:teuthology.orchestra.run.trial047:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(PG_AVAILABILITY\)' | grep -E -v '\(PG_DEGRADED\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'not have an application enabled' | head -n 1 2026-02-25T20:31:15.411 INFO:teuthology.orchestra.run.trial047.stdout:2026-02-25T20:28:15.220367+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 985.144917 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-25T20:31:15.412 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2026-02-25T20:31:15.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:31:15.413 DEBUG:teuthology.orchestra.run.trial047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-25T20:31:15.522 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:31:15.522 DEBUG:teuthology.orchestra.run.trial047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-25T20:31:15.535 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:31:15.535 DEBUG:teuthology.orchestra.run.trial047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-25T20:31:15.589 INFO:tasks.ceph:Archiving mon data... 2026-02-25T20:31:15.591 DEBUG:teuthology.misc:Transferring archived files from trial047:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70594/data/mon.a.tgz 2026-02-25T20:31:15.591 DEBUG:teuthology.orchestra.run.trial047:> mktemp 2026-02-25T20:31:15.638 INFO:teuthology.orchestra.run.trial047.stdout:/tmp/tmp.gF8LF5FdLy 2026-02-25T20:31:15.638 DEBUG:teuthology.orchestra.run.trial047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gF8LF5FdLy 2026-02-25T20:31:15.709 DEBUG:teuthology.orchestra.run.trial047:> sudo chmod 0666 /tmp/tmp.gF8LF5FdLy 2026-02-25T20:31:15.804 DEBUG:teuthology.orchestra.remote:trial047:/tmp/tmp.gF8LF5FdLy is 178KB 2026-02-25T20:31:15.817 DEBUG:teuthology.orchestra.run.trial047:> rm -fr /tmp/tmp.gF8LF5FdLy 2026-02-25T20:31:15.821 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-25T20:31:15.821 DEBUG:teuthology.orchestra.run.trial047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T20:31:15.918 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T20:31:15.918 INFO:tasks.ceph:Archiving crash dumps... 2026-02-25T20:31:15.921 DEBUG:teuthology.misc:Transferring archived files from trial047:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70594/remote/trial047/crash 2026-02-25T20:31:15.922 DEBUG:teuthology.orchestra.run.trial047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T20:31:15.966 INFO:tasks.ceph:Compressing logs... 2026-02-25T20:31:15.967 DEBUG:teuthology.orchestra.run.trial047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T20:31:16.018 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14116.log 2026-02-25T20:31:16.020 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26157.log 2026-02-25T20:31:16.020 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.14116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14116.log.gz 2026-02-25T20:31:16.020 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26131.log 2026-02-25T20:31:16.020 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26313.log 2026-02-25T20:31:16.020 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26157.log.gz 2026-02-25T20:31:16.021 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14092.log 2026-02-25T20:31:16.021 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26131.log: /var/log/ceph/ceph-client.admin.26313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26131.log.gz 2026-02-25T20:31:16.021 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26340.log 2026-02-25T20:31:16.021 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26313.log.gz 2026-02-25T20:31:16.021 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.14092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26183.log 2026-02-25T20:31:16.021 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14092.log.gz 2026-02-25T20:31:16.029 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26235.log/var/log/ceph/ceph-client.admin.26340.log: 2026-02-25T20:31:16.029 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26340.log.gz 2026-02-25T20:31:16.029 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-25T20:31:16.029 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26183.log.gz 2026-02-25T20:31:16.029 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26235.log.gz 2026-02-25T20:31:16.029 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20419.log 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20241.log 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.20419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19985.log 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20419.log.gz 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20241.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.20241.log.gz 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.20010.log 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.19985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19985.log.gz 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20055.log 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26079.log 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20010.log: /var/log/ceph/ceph-client.admin.20055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20010.log.gz 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20055.log.gz 2026-02-25T20:31:16.030 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26079.log.gz 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11467.log 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13951.log 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph.tmp-client.admin.11467.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11467.log.gz 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14068.log 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20445.log 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.13951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.13951.log.gz 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.14068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20318.log 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14068.log.gz 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26287.log 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20445.log.gz 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26364.log 2026-02-25T20:31:16.031 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20318.log.gz 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20245.log 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26287.log.gz 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26364.log.gz 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26261.log 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20245.log: /var/log/ceph/ceph-client.admin.26261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20245.log.gz 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26261.log.gz 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20393.log 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.20393.log: 87.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20393.log.gz 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14152.log 2026-02-25T20:31:16.032 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.14152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14152.log.gz 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26053.log 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20133.log 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr:gzip/var/log/ceph/ceph-client.admin.26053.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.14324.log 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26053.log.gz 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20133.log.gz 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26209.log 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.14324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20240.log 2026-02-25T20:31:16.033 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14324.log.gz 2026-02-25T20:31:16.037 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20165.log 2026-02-25T20:31:16.037 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26209.log.gz 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20240.log.gz 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20035.log 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20081.log 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20165.log.gz 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20035.log.gz 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20107.log 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14023.log 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20081.log.gz 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20107.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20107.log.gz 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.14023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20325.log 2026-02-25T20:31:16.038 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14023.log.gz 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20167.log 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20166.log 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20325.log.gz 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20167.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20167.log.gz 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26105.log 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20166.log.gz 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20319.log 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.26105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26105.log.gz 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-25T20:31:16.039 INFO:teuthology.orchestra.run.trial047.stderr:/var/log/ceph/ceph-client.admin.20319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20319.log.gz 2026-02-25T20:31:16.042 INFO:teuthology.orchestra.run.trial047.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-25T20:31:16.055 INFO:teuthology.orchestra.run.trial047.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-25T20:31:16.066 INFO:teuthology.orchestra.run.trial047.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-25T20:31:16.069 INFO:teuthology.orchestra.run.trial047.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-25T20:31:16.070 INFO:teuthology.orchestra.run.trial047.stderr: 2026-02-25T20:31:16.070 INFO:teuthology.orchestra.run.trial047.stderr:real 0m0.057s 2026-02-25T20:31:16.070 INFO:teuthology.orchestra.run.trial047.stderr:user 0m0.155s 2026-02-25T20:31:16.070 INFO:teuthology.orchestra.run.trial047.stderr:sys 0m0.028s 2026-02-25T20:31:16.071 INFO:tasks.ceph:Archiving logs... 2026-02-25T20:31:16.071 DEBUG:teuthology.misc:Transferring archived files from trial047:/var/log/ceph to /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70594/remote/trial047/log 2026-02-25T20:31:16.073 DEBUG:teuthology.orchestra.run.trial047:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T20:31:16.186 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-25T20:31:16.206 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-25T20:31:16.206 DEBUG:teuthology.orchestra.run.trial047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T20:31:16.305 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-25T20:31:16.316 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-25T20:31:16.316 DEBUG:teuthology.orchestra.run.trial047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T20:31:16.347 INFO:teuthology.orchestra.run.trial047.stdout: remote refid st t when poll reach delay offset jitter 2026-02-25T20:31:16.347 INFO:teuthology.orchestra.run.trial047.stdout:============================================================================== 2026-02-25T20:31:16.347 INFO:teuthology.orchestra.run.trial047.stdout:+172-238-164-57. 168.61.215.74 4 u 23 64 377 27.590 -12.305 12.223 2026-02-25T20:31:16.347 INFO:teuthology.orchestra.run.trial047.stdout:-23.186.168.130 132.163.97.4 2 u 25 64 357 69.684 -15.884 11.037 2026-02-25T20:31:16.348 INFO:teuthology.orchestra.run.trial047.stdout:*t2.time.bf1.yah 98.139.133.62 2 u 16 64 377 82.553 +19.370 11.865 2026-02-25T20:31:16.348 INFO:teuthology.orchestra.run.trial047.stdout:+170-187-147-56. 81.104.22.229 2 u 25 64 377 20.015 -7.049 11.895 2026-02-25T20:31:16.348 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-25T20:31:16.360 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-25T20:31:16.360 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-25T20:31:16.374 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-25T20:31:16.390 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-25T20:31:16.404 INFO:teuthology.task.internal:Duration was 620.028176 seconds 2026-02-25T20:31:16.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-25T20:31:16.418 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-25T20:31:16.418 DEBUG:teuthology.orchestra.run.trial047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T20:31:16.442 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-25T20:31:16.442 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial047.front.sepia.ceph.com 2026-02-25T20:31:16.443 DEBUG:teuthology.orchestra.run.trial047:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T20:31:16.488 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-25T20:31:16.489 DEBUG:teuthology.orchestra.run.trial047:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T20:31:16.757 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-25T20:31:16.757 DEBUG:teuthology.orchestra.run.trial047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T20:31:16.766 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T20:31:16.767 INFO:teuthology.orchestra.run.trial047.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T20:31:16.767 INFO:teuthology.orchestra.run.trial047.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip 0.0% -5 -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz --verbose 2026-02-25T20:31:16.767 INFO:teuthology.orchestra.run.trial047.stderr: -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T20:31:16.768 INFO:teuthology.orchestra.run.trial047.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T20:31:16.839 INFO:teuthology.orchestra.run.trial047.stderr: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T20:31:16.842 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-25T20:31:16.866 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-25T20:31:16.866 DEBUG:teuthology.orchestra.run.trial047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T20:31:16.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-25T20:31:16.905 DEBUG:teuthology.orchestra.run.trial047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T20:31:16.942 INFO:teuthology.orchestra.run.trial047.stdout:kernel.core_pattern = core 2026-02-25T20:31:16.950 DEBUG:teuthology.orchestra.run.trial047:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T20:31:16.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T20:31:16.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-25T20:31:17.007 INFO:teuthology.task.internal:Transferring archived files... 2026-02-25T20:31:17.008 DEBUG:teuthology.misc:Transferring archived files from trial047:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_20:14:14-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70594/remote/trial047 2026-02-25T20:31:17.008 DEBUG:teuthology.orchestra.run.trial047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T20:31:17.092 INFO:teuthology.task.internal:Removing archive directory... 2026-02-25T20:31:17.093 DEBUG:teuthology.orchestra.run.trial047:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T20:31:17.114 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-25T20:31:17.127 INFO:teuthology.task.internal:Not uploading archives. 2026-02-25T20:31:17.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-25T20:31:17.142 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-25T20:31:17.143 DEBUG:teuthology.orchestra.run.trial047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T20:31:17.158 INFO:teuthology.orchestra.run.trial047.stdout: 1311264 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 20:31 /home/ubuntu/cephtest 2026-02-25T20:31:17.160 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-25T20:31:17.175 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-25T20:31:17.211 INFO:teuthology.run:Summary data: description: rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/s3/{auth-order/external-local s3tests} ubuntu_latest} duration: 620.0281758308411 failure_reason: 'Command failed on trial047 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack project create --or-show --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://trial047.front.sepia.ceph.com:5000/v3 --description ''s3tests project'' s3tests --debug"' flavor: default owner: scheduled_aemerson@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-25T20:31:17.211 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T20:31:17.333 INFO:teuthology.run:FAIL