2026-02-22T19:42:57.250 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T19:42:57.266 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T19:42:57.342 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64013 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '64013' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5907 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYokLDDOAcRNSzMqMRXuxTvUAg6WQoh+w3B6gYR5EGmeR4tZlP3THG2Eai3bt0sCR1WQnHdCkpikeq4S6WO6dI= tasks: - install: null - ceph: fs: xfs log-ignorelist: - \(PG_AVAILABILITY\) - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - cram: clients: client.0: - src/test/cli-integration/balancer/misplaced.t teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:40 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T19:42:57.342 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T19:42:57.342 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T19:42:57.342 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T19:42:57.347 INFO:teuthology.task.internal:Checking packages... 2026-02-22T19:42:57.347 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T19:42:57.347 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T19:42:57.347 INFO:teuthology.packaging:ref: None 2026-02-22T19:42:57.347 INFO:teuthology.packaging:tag: None 2026-02-22T19:42:57.347 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T19:42:57.347 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:42:57.347 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T19:42:57.470 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689.gf90f4eae 2026-02-22T19:42:57.471 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T19:42:57.483 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T19:42:57.483 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T19:42:57.502 INFO:teuthology.task.internal:Saving configuration 2026-02-22T19:42:57.512 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T19:42:57.523 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T19:42:57.599 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial155.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64013', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 19:38:24.697674', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYokLDDOAcRNSzMqMRXuxTvUAg6WQoh+w3B6gYR5EGmeR4tZlP3THG2Eai3bt0sCR1WQnHdCkpikeq4S6WO6dI='} 2026-02-22T19:42:57.599 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T19:42:57.614 INFO:teuthology.task.internal:roles: ubuntu@trial155.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-22T19:42:57.614 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T19:42:57.696 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7cc10d91cea0>, signals=[15]) 2026-02-22T19:42:57.696 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T19:42:57.709 INFO:teuthology.task.internal:Opening connections... 2026-02-22T19:42:57.709 DEBUG:teuthology.task.internal:connecting to ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:42:57.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T19:42:57.775 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T19:42:57.787 DEBUG:teuthology.orchestra.run.trial155:> uname -m 2026-02-22T19:42:57.902 INFO:teuthology.orchestra.run.trial155.stdout:x86_64 2026-02-22T19:42:57.903 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T19:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T19:42:57.940 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server 2026-02-22T19:42:58.013 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T19:42:58.025 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T19:42:58.038 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T19:42:58.038 DEBUG:teuthology.orchestra.run.trial155:> test '!' -e /home/ubuntu/cephtest 2026-02-22T19:42:58.054 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T19:42:58.066 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T19:42:58.066 DEBUG:teuthology.orchestra.run.trial155:> test -z $(ls -A /var/lib/ceph) 2026-02-22T19:42:58.110 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T19:42:58.192 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T19:42:58.215 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T19:42:58.215 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T19:42:58.215 DEBUG:teuthology.orchestra.run.trial155:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T19:42:58.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:42:58.231 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-22T19:42:58.287 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-681.el9.x86_64 2026-02-22T19:42:58.287 INFO:teuthology.task.kernel:Running kernel on trial155: 5.14.0-681.el9.x86_64 2026-02-22T19:42:58.287 DEBUG:teuthology.orchestra.run.trial155:> sudo yum install -y kernel 2026-02-22T19:42:59.312 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.9 MB 00:00 2026-02-22T19:43:04.524 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 27 MB 00:04 2026-02-22T19:43:10.324 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 7.8 MB 00:03 2026-02-22T19:43:11.339 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 20 kB 00:00 2026-02-22T19:43:11.821 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 48 MB/s | 20 MB 00:00 2026-02-22T19:43:15.067 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-22T19:43:16.082 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T19:43:16.083 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T19:43:16.102 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:43:16.102 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:43:16.102 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:43:16.126 DEBUG:teuthology.orchestra.run.trial155:> echo no | sudo yum reinstall kernel || true 2026-02-22T19:43:16.427 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 07:43:15 PM UTC. 2026-02-22T19:43:16.507 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalling: 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 803 k 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 0 2026-02-22T19:43:16.508 INFO:teuthology.orchestra.run.trial155.stderr:Operation aborted. 2026-02-22T19:43:16.529 INFO:teuthology.orchestra.run.trial155.stdout:Is this ok [y/N]: 2026-02-22T19:43:16.529 DEBUG:teuthology.orchestra.run.trial155:> sudo yum reinstall -y kernel || true 2026-02-22T19:43:16.826 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 07:43:15 PM UTC. 2026-02-22T19:43:16.909 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalling: 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 803 k 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 0 2026-02-22T19:43:16.910 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:43:25.197 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64.rpm 98 kB/s | 803 kB 00:08 2026-02-22T19:43:25.197 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:43:25.197 INFO:teuthology.orchestra.run.trial155.stdout:Total 97 kB/s | 803 kB 00:08 2026-02-22T19:43:25.207 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:43:25.241 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:43:25.241 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:43:25.245 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:43:25.246 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:43:25.269 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:43:25.273 INFO:teuthology.orchestra.run.trial155.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T19:43:25.273 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T19:43:25.382 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T19:43:25.382 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T19:43:25.438 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T19:43:25.438 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:43:25.438 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalled: 2026-02-22T19:43:25.438 INFO:teuthology.orchestra.run.trial155.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T19:43:25.438 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:43:25.438 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:43:25.465 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T19:43:25.490 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T19:43:25.490 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T19:43:25.490 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T19:43:25.490 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T19:43:25.491 DEBUG:teuthology.orchestra.run.trial155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T19:43:25.554 INFO:teuthology.orchestra.run.trial155.stdout:ttyS1 2026-02-22T19:43:25.587 DEBUG:teuthology.parallel:result is None 2026-02-22T19:43:25.587 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T19:43:25.599 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T19:43:25.600 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T19:43:25.642 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T19:43:25.657 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T19:43:25.671 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T19:43:25.671 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T19:43:25.701 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T19:43:25.713 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T19:43:25.713 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T19:43:25.762 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T19:43:25.770 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T19:43:25.771 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T19:43:25.785 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T19:43:25.785 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T19:43:25.835 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T19:43:25.849 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T19:43:25.849 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T19:43:25.891 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T19:43:26.012 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T19:43:26.036 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T19:43:26.167 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T19:43:26.191 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:43:26.191 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T19:43:26.254 DEBUG:teuthology.orchestra.run.trial155:> sudo service rsyslog restart 2026-02-22T19:43:26.322 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T19:43:26.812 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T19:43:26.825 INFO:teuthology.task.internal:Starting timer... 2026-02-22T19:43:26.825 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T19:43:26.843 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T19:43:26.857 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-22T19:43:26.857 DEBUG:teuthology.orchestra.run.trial155:> sudo service auditd rotate 2026-02-22T19:43:26.885 INFO:teuthology.orchestra.run.trial155.stdout:Rotating logs: 2026-02-22T19:43:26.886 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T19:43:26.886 DEBUG:teuthology.orchestra.run.trial155:> /usr/sbin/getenforce 2026-02-22T19:43:26.942 INFO:teuthology.orchestra.run.trial155.stdout:Permissive 2026-02-22T19:43:26.942 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial155.front.sepia.ceph.com': 'permissive'} 2026-02-22T19:43:26.942 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T19:43:27.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:43:27.007 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T19:43:27.007 DEBUG:teuthology.orchestra.run.trial155:> sudo /usr/sbin/setenforce permissive 2026-02-22T19:43:27.071 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T19:43:27.085 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T19:43:27.092 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T19:43:27.092 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T19:45:49.282 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial155.front.sepia.ceph.com')] 2026-02-22T19:45:49.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-22T19:45:49.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T19:45:49.353 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-22T19:45:49.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-22T19:45:49.437 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T19:45:49.452 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T19:45:49.452 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T19:45:49.452 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T19:45:49.503 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T19:45:49.515 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T19:45:49.536 INFO:teuthology.orchestra.run.trial155.stderr:sudo: ntpd: command not found 2026-02-22T19:45:49.546 INFO:teuthology.orchestra.run.trial155.stdout:506 Cannot talk to daemon 2026-02-22T19:45:49.558 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T19:45:49.570 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T19:45:49.619 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-22T19:45:49.880 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T19:45:49.880 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-22T19:45:49.880 INFO:teuthology.orchestra.run.trial155.stdout:^? 172-233-157-223.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T19:45:49.880 INFO:teuthology.orchestra.run.trial155.stdout:^? 108.61.215.221.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T19:45:49.880 INFO:teuthology.orchestra.run.trial155.stdout:^? time.ecansol.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T19:45:49.880 INFO:teuthology.orchestra.run.trial155.stdout:^? ntp4.lonet.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T19:45:49.880 INFO:teuthology.run_tasks:Running task install... 2026-02-22T19:45:49.892 DEBUG:teuthology.task.install:project ceph 2026-02-22T19:45:49.892 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T19:45:49.892 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T19:45:49.892 INFO:teuthology.task.install:Using flavor: default 2026-02-22T19:45:49.895 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T19:45:49.895 INFO:teuthology.task.install:extra packages: [] 2026-02-22T19:45:49.895 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T19:45:49.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:45:50.029 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T19:45:50.029 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T19:45:50.142 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T19:45:50.142 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:45:50.142 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T19:45:50.168 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-22T19:45:50.168 DEBUG:teuthology.orchestra.run.trial155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T19:45:50.232 DEBUG:teuthology.orchestra.run.trial155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T19:45:50.306 DEBUG:teuthology.orchestra.run.trial155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T19:45:50.369 INFO:teuthology.orchestra.run.trial155.stdout:check_obsoletes = 1 2026-02-22T19:45:50.370 DEBUG:teuthology.orchestra.run.trial155:> sudo yum clean all 2026-02-22T19:45:50.528 INFO:teuthology.orchestra.run.trial155.stdout:41 files removed 2026-02-22T19:45:50.542 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-radosgw 2026-02-22T19:45:50.857 INFO:teuthology.orchestra.run.trial155.stdout:ceph packages for x86_64 493 kB/s | 86 kB 00:00 2026-02-22T19:45:50.993 INFO:teuthology.orchestra.run.trial155.stdout:ceph noarch packages 111 kB/s | 12 kB 00:00 2026-02-22T19:45:51.130 INFO:teuthology.orchestra.run.trial155.stdout:ceph source packages 16 kB/s | 1.9 kB 00:00 2026-02-22T19:45:52.254 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 8.9 MB 00:01 2026-02-22T19:45:53.315 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 51 MB/s | 27 MB 00:00 2026-02-22T19:45:57.498 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 7.8 MB 00:01 2026-02-22T19:45:58.602 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 20 kB 00:00 2026-02-22T19:45:59.601 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-22T19:46:02.802 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-22T19:46:04.013 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout:Upgrading: 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T19:46:04.014 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout:Install 33 Packages 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout:Upgrade 2 Packages 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 63 M 2026-02-22T19:46:04.015 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:46:08.221 INFO:teuthology.orchestra.run.trial155.stdout:(1/35): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 1.4 MB/s | 5.5 MB 00:03 2026-02-22T19:46:08.285 INFO:teuthology.orchestra.run.trial155.stdout:(2/35): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 394 kB/s | 25 kB 00:00 2026-02-22T19:46:08.946 INFO:teuthology.orchestra.run.trial155.stdout:(3/35): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 1.5 MB/s | 999 kB 00:00 2026-02-22T19:46:09.215 INFO:teuthology.orchestra.run.trial155.stdout:(4/35): libradosstriper1-19.2.3-689.gf90f4eae.e 1.8 MB/s | 503 kB 00:00 2026-02-22T19:46:10.312 INFO:teuthology.orchestra.run.trial155.stdout:(5/35): ceph-radosgw-19.2.3-689.gf90f4eae.el9.x 1.8 MB/s | 11 MB 00:06 2026-02-22T19:46:10.379 INFO:teuthology.orchestra.run.trial155.stdout:(6/35): python3-ceph-argparse-19.2.3-689.gf90f4 674 kB/s | 45 kB 00:00 2026-02-22T19:46:10.715 INFO:teuthology.orchestra.run.trial155.stdout:(7/35): python3-ceph-common-19.2.3-689.gf90f4ea 424 kB/s | 142 kB 00:00 2026-02-22T19:46:10.950 INFO:teuthology.orchestra.run.trial155.stdout:(8/35): ceph-common-19.2.3-689.gf90f4eae.el9.x8 3.3 MB/s | 22 MB 00:06 2026-02-22T19:46:10.951 INFO:teuthology.orchestra.run.trial155.stdout:(9/35): python3-cephfs-19.2.3-689.gf90f4eae.el9 698 kB/s | 165 kB 00:00 2026-02-22T19:46:11.071 INFO:teuthology.orchestra.run.trial155.stdout:(10/35): python3-rados-19.2.3-689.gf90f4eae.el9 2.6 MB/s | 322 kB 00:00 2026-02-22T19:46:11.138 INFO:teuthology.orchestra.run.trial155.stdout:(11/35): python3-rgw-19.2.3-689.gf90f4eae.el9.x 1.5 MB/s | 100 kB 00:00 2026-02-22T19:46:11.221 INFO:teuthology.orchestra.run.trial155.stdout:(12/35): mailcap-2.1.49-5.el9.noarch.rpm 401 kB/s | 33 kB 00:00 2026-02-22T19:46:11.269 INFO:teuthology.orchestra.run.trial155.stdout:(13/35): python3-rbd-19.2.3-689.gf90f4eae.el9.x 954 kB/s | 303 kB 00:00 2026-02-22T19:46:11.374 INFO:teuthology.orchestra.run.trial155.stdout:(14/35): nvme-cli-2.16-1.el9.x86_64.rpm 7.5 MB/s | 1.2 MB 00:00 2026-02-22T19:46:11.390 INFO:teuthology.orchestra.run.trial155.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 766 kB/s | 93 kB 00:00 2026-02-22T19:46:11.415 INFO:teuthology.orchestra.run.trial155.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 2.5 MB/s | 104 kB 00:00 2026-02-22T19:46:11.433 INFO:teuthology.orchestra.run.trial155.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 8.7 MB/s | 160 kB 00:00 2026-02-22T19:46:11.434 INFO:teuthology.orchestra.run.trial155.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-22T19:46:11.442 INFO:teuthology.orchestra.run.trial155.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.6 MB/s | 45 kB 00:00 2026-02-22T19:46:11.463 INFO:teuthology.orchestra.run.trial155.stdout:(20/35): librdkafka-1.6.1-102.el9.x86_64.rpm 23 MB/s | 662 kB 00:00 2026-02-22T19:46:11.465 INFO:teuthology.orchestra.run.trial155.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 13 MB/s | 292 kB 00:00 2026-02-22T19:46:11.474 INFO:teuthology.orchestra.run.trial155.stdout:(22/35): qatlib-25.08.0-2.el9.x86_64.rpm 21 MB/s | 240 kB 00:00 2026-02-22T19:46:11.475 INFO:teuthology.orchestra.run.trial155.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 3.9 MB/s | 37 kB 00:00 2026-02-22T19:46:11.484 INFO:teuthology.orchestra.run.trial155.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 6.8 MB/s | 66 kB 00:00 2026-02-22T19:46:11.637 INFO:teuthology.orchestra.run.trial155.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2026-02-22T19:46:11.658 INFO:teuthology.orchestra.run.trial155.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.1 MB/s | 25 kB 00:00 2026-02-22T19:46:11.684 INFO:teuthology.orchestra.run.trial155.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2026-02-22T19:46:11.708 INFO:teuthology.orchestra.run.trial155.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2026-02-22T19:46:11.761 INFO:teuthology.orchestra.run.trial155.stdout:(29/35): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-22T19:46:11.771 INFO:teuthology.orchestra.run.trial155.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 13 MB/s | 838 kB 00:00 2026-02-22T19:46:11.789 INFO:teuthology.orchestra.run.trial155.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 6.9 MB/s | 191 kB 00:00 2026-02-22T19:46:11.821 INFO:teuthology.orchestra.run.trial155.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 32 MB/s | 1.6 MB 00:00 2026-02-22T19:46:12.695 INFO:teuthology.orchestra.run.trial155.stdout:(33/35): librgw2-19.2.3-689.gf90f4eae.el9.x86_6 1.6 MB/s | 5.4 MB 00:03 2026-02-22T19:46:15.382 INFO:teuthology.orchestra.run.trial155.stdout:(34/35): librados2-19.2.3-689.gf90f4eae.el9.x86 978 kB/s | 3.4 MB 00:03 2026-02-22T19:46:18.089 INFO:teuthology.orchestra.run.trial155.stdout:(35/35): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 517 kB/s | 3.2 MB 00:06 2026-02-22T19:46:18.094 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:46:18.095 INFO:teuthology.orchestra.run.trial155.stdout:Total 4.5 MB/s | 63 MB 00:14 2026-02-22T19:46:18.189 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:46:18.207 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:46:18.207 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:46:18.462 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:46:18.462 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:46:18.753 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:46:18.762 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-22T19:46:18.766 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-22T19:46:18.777 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-22T19:46:18.937 INFO:teuthology.orchestra.run.trial155.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-22T19:46:18.941 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T19:46:18.971 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T19:46:19.016 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T19:46:19.017 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T19:46:19.029 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T19:46:19.033 INFO:teuthology.orchestra.run.trial155.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-22T19:46:19.043 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/37 2026-02-22T19:46:19.066 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T19:46:19.067 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T19:46:19.080 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T19:46:19.111 INFO:teuthology.orchestra.run.trial155.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-22T19:46:19.114 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-22T19:46:19.121 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-22T19:46:19.123 INFO:teuthology.orchestra.run.trial155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-22T19:46:19.126 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-22T19:46:19.131 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-22T19:46:19.278 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T19:46:19.279 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T19:46:19.305 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T19:46:19.307 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/37 2026-02-22T19:46:19.313 INFO:teuthology.orchestra.run.trial155.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-22T19:46:19.553 INFO:teuthology.orchestra.run.trial155.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-22T19:46:19.554 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T19:46:19.570 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T19:46:19.576 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/37 2026-02-22T19:46:19.580 INFO:teuthology.orchestra.run.trial155.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-22T19:46:19.583 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-22T19:46:19.584 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T19:46:19.600 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T19:46:19.714 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-22T19:46:19.717 INFO:teuthology.orchestra.run.trial155.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T19:46:19.998 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T19:46:19.998 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T19:46:19.999 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:20.033 INFO:teuthology.orchestra.run.trial155.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-22T19:46:20.035 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 31/37 2026-02-22T19:46:21.060 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T19:46:21.062 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T19:46:21.355 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T19:46:21.359 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T19:46:21.400 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T19:46:21.400 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T19:46:21.401 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T19:46:21.401 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:21.404 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /sys 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /proc 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /mnt 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /var/tmp 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /home 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /root 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /tmp 2026-02-22T19:46:25.898 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:26.361 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T19:46:26.385 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T19:46:26.385 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:46:26.385 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T19:46:26.385 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T19:46:26.385 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T19:46:26.385 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:26.387 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T19:46:26.401 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T19:46:26.401 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T19:46:26.455 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T19:46:26.455 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'qat' with GID 992. 2026-02-22T19:46:26.455 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/37 2026-02-22T19:46:26.732 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-22T19:46:26.733 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 36/37 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout:Upgraded: 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.794 INFO:teuthology.orchestra.run.trial155.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:26.795 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:46:26.836 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-test 2026-02-22T19:46:27.146 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:25 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout:Install 5 Packages 2026-02-22T19:46:27.231 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:46:27.232 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 50 M 2026-02-22T19:46:27.232 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 212 M 2026-02-22T19:46:27.232 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:46:27.916 INFO:teuthology.orchestra.run.trial155.stdout:(1/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 274 kB/s | 163 kB 00:00 2026-02-22T19:46:28.119 INFO:teuthology.orchestra.run.trial155.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 291 kB/s | 233 kB 00:00 2026-02-22T19:46:28.202 INFO:teuthology.orchestra.run.trial155.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 769 kB/s | 64 kB 00:00 2026-02-22T19:46:29.253 INFO:teuthology.orchestra.run.trial155.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 227 kB/s | 303 kB 00:01 2026-02-22T19:47:08.466 INFO:teuthology.orchestra.run.trial155.stdout:(5/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 1.2 MB/s | 50 MB 00:41 2026-02-22T19:47:08.467 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:47:08.467 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.2 MB/s | 50 MB 00:41 2026-02-22T19:47:08.492 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:47:08.502 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:47:08.503 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:47:08.688 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:47:08.688 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:47:08.898 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:47:08.904 INFO:teuthology.orchestra.run.trial155.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-22T19:47:08.908 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-22T19:47:08.916 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-22T19:47:08.917 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T19:47:11.162 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T19:47:11.180 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T19:47:11.408 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T19:47:11.408 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-22T19:47:11.409 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-22T19:47:11.409 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-22T19:47:11.409 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:11.466 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:11.499 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph 2026-02-22T19:47:11.805 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:09 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:11.891 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:11.893 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T19:47:11.893 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T19:47:11.894 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T19:47:11.895 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T19:47:11.896 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T19:47:11.897 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T19:47:11.898 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T19:47:11.899 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T19:47:11.900 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-22T19:47:11.901 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T19:47:11.902 INFO:teuthology.orchestra.run.trial155.stdout:Install 99 Packages 2026-02-22T19:47:11.903 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:11.903 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 95 M 2026-02-22T19:47:11.903 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 520 M 2026-02-22T19:47:11.904 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:47:12.786 INFO:teuthology.orchestra.run.trial155.stdout:(1/99): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 23 kB/s | 6.5 kB 00:00 2026-02-22T19:47:13.497 INFO:teuthology.orchestra.run.trial155.stdout:(2/99): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 1.1 MB/s | 1.1 MB 00:00 2026-02-22T19:47:15.707 INFO:teuthology.orchestra.run.trial155.stdout:(3/99): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 777 kB/s | 2.4 MB 00:03 2026-02-22T19:47:15.774 INFO:teuthology.orchestra.run.trial155.stdout:(4/99): ceph-grafana-dashboards-19.2.3-689.gf90 466 kB/s | 31 kB 00:00 2026-02-22T19:47:16.050 INFO:teuthology.orchestra.run.trial155.stdout:(5/99): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 545 kB/s | 150 kB 00:00 2026-02-22T19:47:21.751 INFO:teuthology.orchestra.run.trial155.stdout:(6/99): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_6 541 kB/s | 4.7 MB 00:08 2026-02-22T19:47:25.114 INFO:teuthology.orchestra.run.trial155.stdout:(7/99): ceph-mgr-dashboard-19.2.3-689.gf90f4eae 430 kB/s | 3.8 MB 00:09 2026-02-22T19:47:25.184 INFO:teuthology.orchestra.run.trial155.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 318 kB/s | 22 kB 00:00 2026-02-22T19:47:25.666 INFO:teuthology.orchestra.run.trial155.stdout:(9/99): ceph-mgr-modules-core-19.2.3-689.gf90f4 524 kB/s | 253 kB 00:00 2026-02-22T19:47:25.805 INFO:teuthology.orchestra.run.trial155.stdout:(10/99): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 353 kB/s | 49 kB 00:00 2026-02-22T19:47:25.876 INFO:teuthology.orchestra.run.trial155.stdout:(11/99): ceph-prometheus-alerts-19.2.3-689.gf90 235 kB/s | 17 kB 00:00 2026-02-22T19:47:26.570 INFO:teuthology.orchestra.run.trial155.stdout:(12/99): ceph-volume-19.2.3-689.gf90f4eae.el9.n 431 kB/s | 299 kB 00:00 2026-02-22T19:47:28.435 INFO:teuthology.orchestra.run.trial155.stdout:(13/99): cephadm-19.2.3-689.gf90f4eae.el9.noarc 412 kB/s | 769 kB 00:01 2026-02-22T19:47:30.081 INFO:teuthology.orchestra.run.trial155.stdout:(14/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 213 kB/s | 351 kB 00:01 2026-02-22T19:47:30.317 INFO:teuthology.orchestra.run.trial155.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 172 kB/s | 40 kB 00:00 2026-02-22T19:47:30.632 INFO:teuthology.orchestra.run.trial155.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 229 kB/s | 72 kB 00:00 2026-02-22T19:47:30.817 INFO:teuthology.orchestra.run.trial155.stdout:(17/99): ceph-mgr-diskprediction-local-19.2.3-6 836 kB/s | 7.4 MB 00:09 2026-02-22T19:47:31.905 INFO:teuthology.orchestra.run.trial155.stdout:(18/99): libgfortran-11.5.0-14.el9.x86_64.rpm 624 kB/s | 794 kB 00:01 2026-02-22T19:47:31.927 INFO:teuthology.orchestra.run.trial155.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 166 kB/s | 184 kB 00:01 2026-02-22T19:47:32.304 INFO:teuthology.orchestra.run.trial155.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 635 kB/s | 253 kB 00:00 2026-02-22T19:47:32.541 INFO:teuthology.orchestra.run.trial155.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 449 kB/s | 106 kB 00:00 2026-02-22T19:47:32.783 INFO:teuthology.orchestra.run.trial155.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 558 kB/s | 135 kB 00:00 2026-02-22T19:47:32.942 INFO:teuthology.orchestra.run.trial155.stdout:[MIRROR] python3-pyparsing-2.4.7-9.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-pyparsing-2.4.7-9.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-22T19:47:33.582 INFO:teuthology.orchestra.run.trial155.stdout:[MIRROR] python3-pyparsing-2.4.7-9.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-pyparsing-2.4.7-9.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-22T19:47:33.651 INFO:teuthology.orchestra.run.trial155.stdout:(23/99): python3-pyparsing-2.4.7-9.el9.noarch.r 173 kB/s | 150 kB 00:00 2026-02-22T19:47:34.054 INFO:teuthology.orchestra.run.trial155.stdout:[MIRROR] python3-requests-2.25.1-10.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-requests-2.25.1-10.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-22T19:47:34.132 INFO:teuthology.orchestra.run.trial155.stdout:(24/99): python3-cryptography-36.0.1-5.el9.x86_ 578 kB/s | 1.2 MB 00:02 2026-02-22T19:47:34.213 INFO:teuthology.orchestra.run.trial155.stdout:[MIRROR] python3-requests-2.25.1-10.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-requests-2.25.1-10.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-22T19:47:34.235 INFO:teuthology.orchestra.run.trial155.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 217 kB/s | 126 kB 00:00 2026-02-22T19:47:34.532 INFO:teuthology.orchestra.run.trial155.stdout:[MIRROR] python3-urllib3-1.26.5-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-urllib3-1.26.5-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-22T19:47:34.955 INFO:teuthology.orchestra.run.trial155.stdout:(26/99): unzip-6.0-59.el9.x86_64.rpm 252 kB/s | 182 kB 00:00 2026-02-22T19:47:35.243 INFO:teuthology.orchestra.run.trial155.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 196 kB/s | 218 kB 00:01 2026-02-22T19:47:35.284 INFO:teuthology.orchestra.run.trial155.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 723 kB/s | 30 kB 00:00 2026-02-22T19:47:35.358 INFO:teuthology.orchestra.run.trial155.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 661 kB/s | 266 kB 00:00 2026-02-22T19:47:35.384 INFO:teuthology.orchestra.run.trial155.stdout:(30/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 30 MB/s | 3.0 MB 00:00 2026-02-22T19:47:35.385 INFO:teuthology.orchestra.run.trial155.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 564 kB/s | 15 kB 00:00 2026-02-22T19:47:35.401 INFO:teuthology.orchestra.run.trial155.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 14 MB/s | 246 kB 00:00 2026-02-22T19:47:35.411 INFO:teuthology.orchestra.run.trial155.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 4.3 MB/s | 42 kB 00:00 2026-02-22T19:47:35.418 INFO:teuthology.orchestra.run.trial155.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 5.4 MB/s | 188 kB 00:00 2026-02-22T19:47:35.449 INFO:teuthology.orchestra.run.trial155.stdout:(35/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 140 MB/s | 5.3 MB 00:00 2026-02-22T19:47:35.455 INFO:teuthology.orchestra.run.trial155.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 27 MB/s | 1.0 MB 00:00 2026-02-22T19:47:35.468 INFO:teuthology.orchestra.run.trial155.stdout:(37/99): python3-devel-3.9.25-3.el9.x86_64.rpm 19 MB/s | 244 kB 00:00 2026-02-22T19:47:35.482 INFO:teuthology.orchestra.run.trial155.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 17 MB/s | 249 kB 00:00 2026-02-22T19:47:35.500 INFO:teuthology.orchestra.run.trial155.stdout:(39/99): python3-babel-2.9.1-2.el9.noarch.rpm 117 MB/s | 6.0 MB 00:00 2026-02-22T19:47:35.501 INFO:teuthology.orchestra.run.trial155.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 9.5 MB/s | 177 kB 00:00 2026-02-22T19:47:35.514 INFO:teuthology.orchestra.run.trial155.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 13 MB/s | 172 kB 00:00 2026-02-22T19:47:35.519 INFO:teuthology.orchestra.run.trial155.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 66 MB/s | 1.2 MB 00:00 2026-02-22T19:47:35.524 INFO:teuthology.orchestra.run.trial155.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 3.4 MB/s | 35 kB 00:00 2026-02-22T19:47:35.538 INFO:teuthology.orchestra.run.trial155.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 32 MB/s | 442 kB 00:00 2026-02-22T19:47:35.555 INFO:teuthology.orchestra.run.trial155.stdout:(45/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 170 MB/s | 6.1 MB 00:00 2026-02-22T19:47:35.555 INFO:teuthology.orchestra.run.trial155.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 4.3 MB/s | 77 kB 00:00 2026-02-22T19:47:35.567 INFO:teuthology.orchestra.run.trial155.stdout:(47/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 14 MB/s | 159 kB 00:00 2026-02-22T19:47:35.568 INFO:teuthology.orchestra.run.trial155.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 21 MB/s | 267 kB 00:00 2026-02-22T19:47:35.578 INFO:teuthology.orchestra.run.trial155.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 5.0 MB/s | 54 kB 00:00 2026-02-22T19:47:35.580 INFO:teuthology.orchestra.run.trial155.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 21 MB/s | 279 kB 00:00 2026-02-22T19:47:35.591 INFO:teuthology.orchestra.run.trial155.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 3.8 MB/s | 42 kB 00:00 2026-02-22T19:47:35.602 INFO:teuthology.orchestra.run.trial155.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 15 MB/s | 189 kB 00:00 2026-02-22T19:47:35.615 INFO:teuthology.orchestra.run.trial155.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 7.5 MB/s | 90 kB 00:00 2026-02-22T19:47:35.679 INFO:teuthology.orchestra.run.trial155.stdout:(54/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 192 MB/s | 19 MB 00:00 2026-02-22T19:47:36.161 INFO:teuthology.orchestra.run.trial155.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 41 kB/s | 22 kB 00:00 2026-02-22T19:47:36.331 INFO:teuthology.orchestra.run.trial155.stdout:(56/99): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_ 765 kB/s | 17 MB 00:22 2026-02-22T19:47:36.586 INFO:teuthology.orchestra.run.trial155.stdout:(57/99): protobuf-compiler-3.14.0-17.el9.x86_64 950 kB/s | 862 kB 00:00 2026-02-22T19:47:36.588 INFO:teuthology.orchestra.run.trial155.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 76 kB/s | 19 kB 00:00 2026-02-22T19:47:36.651 INFO:teuthology.orchestra.run.trial155.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-22T19:47:36.866 INFO:teuthology.orchestra.run.trial155.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 137 kB/s | 29 kB 00:00 2026-02-22T19:47:36.934 INFO:teuthology.orchestra.run.trial155.stdout:(61/99): luarocks-3.9.2-5.el9.noarch.rpm 435 kB/s | 151 kB 00:00 2026-02-22T19:47:37.090 INFO:teuthology.orchestra.run.trial155.stdout:(62/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.1 MB/s | 548 kB 00:00 2026-02-22T19:47:37.145 INFO:teuthology.orchestra.run.trial155.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 206 kB/s | 43 kB 00:00 2026-02-22T19:47:37.152 INFO:teuthology.orchestra.run.trial155.stdout:(64/99): python3-backports-tarfile-1.2.0-1.el9. 210 kB/s | 60 kB 00:00 2026-02-22T19:47:37.286 INFO:teuthology.orchestra.run.trial155.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 100 kB/s | 14 kB 00:00 2026-02-22T19:47:37.308 INFO:teuthology.orchestra.run.trial155.stdout:(66/99): python3-cachetools-4.2.4-1.el9.noarch. 148 kB/s | 32 kB 00:00 2026-02-22T19:47:37.500 INFO:teuthology.orchestra.run.trial155.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 499 kB/s | 173 kB 00:00 2026-02-22T19:47:37.708 INFO:teuthology.orchestra.run.trial155.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 850 kB/s | 358 kB 00:00 2026-02-22T19:47:37.727 INFO:teuthology.orchestra.run.trial155.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 606 kB/s | 254 kB 00:00 2026-02-22T19:47:38.070 INFO:teuthology.orchestra.run.trial155.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 399 kB/s | 144 kB 00:00 2026-02-22T19:47:38.082 INFO:teuthology.orchestra.run.trial155.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 392 kB/s | 139 kB 00:00 2026-02-22T19:47:38.194 INFO:teuthology.orchestra.run.trial155.stdout:(72/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.9 MB/s | 2.0 MB 00:00 2026-02-22T19:47:38.228 INFO:teuthology.orchestra.run.trial155.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 73 kB/s | 11 kB 00:00 2026-02-22T19:47:38.356 INFO:teuthology.orchestra.run.trial155.stdout:(74/99): python3-isodate-0.6.1-3.el9.noarch.rpm 195 kB/s | 56 kB 00:00 2026-02-22T19:47:38.409 INFO:teuthology.orchestra.run.trial155.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 82 kB/s | 18 kB 00:00 2026-02-22T19:47:38.446 INFO:teuthology.orchestra.run.trial155.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 107 kB/s | 23 kB 00:00 2026-02-22T19:47:38.565 INFO:teuthology.orchestra.run.trial155.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 94 kB/s | 20 kB 00:00 2026-02-22T19:47:38.617 INFO:teuthology.orchestra.run.trial155.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 93 kB/s | 19 kB 00:00 2026-02-22T19:47:38.653 INFO:teuthology.orchestra.run.trial155.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 127 kB/s | 26 kB 00:00 2026-02-22T19:47:38.906 INFO:teuthology.orchestra.run.trial155.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 160 kB/s | 46 kB 00:00 2026-02-22T19:47:38.932 INFO:teuthology.orchestra.run.trial155.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 283 kB/s | 79 kB 00:00 2026-02-22T19:47:39.143 INFO:teuthology.orchestra.run.trial155.stdout:(82/99): python3-kubernetes-26.1.0-3.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2026-02-22T19:47:39.196 INFO:teuthology.orchestra.run.trial155.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 298 kB/s | 86 kB 00:00 2026-02-22T19:47:39.219 INFO:teuthology.orchestra.run.trial155.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 201 kB/s | 58 kB 00:00 2026-02-22T19:47:39.412 INFO:teuthology.orchestra.run.trial155.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 76 kB/s | 16 kB 00:00 2026-02-22T19:47:39.519 INFO:teuthology.orchestra.run.trial155.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 299 kB/s | 90 kB 00:00 2026-02-22T19:47:39.563 INFO:teuthology.orchestra.run.trial155.stdout:(87/99): python3-pecan-1.4.2-3.el9.noarch.rpm 647 kB/s | 272 kB 00:00 2026-02-22T19:47:39.621 INFO:teuthology.orchestra.run.trial155.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 147 kB/s | 31 kB 00:00 2026-02-22T19:47:39.841 INFO:teuthology.orchestra.run.trial155.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 213 kB/s | 59 kB 00:00 2026-02-22T19:47:39.887 INFO:teuthology.orchestra.run.trial155.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 513 kB/s | 188 kB 00:00 2026-02-22T19:47:39.972 INFO:teuthology.orchestra.run.trial155.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 357 kB/s | 125 kB 00:00 2026-02-22T19:47:40.059 INFO:teuthology.orchestra.run.trial155.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 164 kB/s | 36 kB 00:00 2026-02-22T19:47:40.174 INFO:teuthology.orchestra.run.trial155.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 301 kB/s | 86 kB 00:00 2026-02-22T19:47:40.349 INFO:teuthology.orchestra.run.trial155.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 309 kB/s | 90 kB 00:00 2026-02-22T19:47:40.405 INFO:teuthology.orchestra.run.trial155.stdout:(95/99): python3-webob-1.8.8-2.el9.noarch.rpm 532 kB/s | 230 kB 00:00 2026-02-22T19:47:40.617 INFO:teuthology.orchestra.run.trial155.stdout:(96/99): python3-xmltodict-0.12.0-15.el9.noarch 105 kB/s | 22 kB 00:00 2026-02-22T19:47:40.629 INFO:teuthology.orchestra.run.trial155.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 173 kB/s | 48 kB 00:00 2026-02-22T19:47:40.643 INFO:teuthology.orchestra.run.trial155.stdout:(98/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 910 kB/s | 427 kB 00:00 2026-02-22T19:47:40.832 INFO:teuthology.orchestra.run.trial155.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 93 kB/s | 20 kB 00:00 2026-02-22T19:47:40.840 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:47:40.840 INFO:teuthology.orchestra.run.trial155.stdout:Total 3.3 MB/s | 95 MB 00:28 2026-02-22T19:47:41.250 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:47:41.290 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:47:41.290 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:47:41.711 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:47:41.711 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:47:42.177 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:47:42.179 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-22T19:47:42.210 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-22T19:47:42.215 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-22T19:47:42.237 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-22T19:47:42.243 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-22T19:47:42.276 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-22T19:47:42.285 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-22T19:47:42.290 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-22T19:47:42.293 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-22T19:47:42.297 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-22T19:47:42.320 INFO:teuthology.orchestra.run.trial155.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-22T19:47:42.333 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-22T19:47:42.335 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-22T19:47:42.342 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-22T19:47:42.343 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-22T19:47:42.354 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-22T19:47:42.361 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-22T19:47:42.385 INFO:teuthology.orchestra.run.trial155.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-22T19:47:42.388 INFO:teuthology.orchestra.run.trial155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-22T19:47:42.395 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-22T19:47:42.420 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-22T19:47:42.471 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-22T19:47:42.484 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-22T19:47:42.486 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-22T19:47:42.491 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-22T19:47:42.496 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-22T19:47:42.501 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-22T19:47:42.504 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-22T19:47:42.518 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-22T19:47:42.539 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-22T19:47:42.543 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-22T19:47:42.548 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-22T19:47:42.560 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-22T19:47:42.569 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-22T19:47:42.575 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-22T19:47:42.594 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-22T19:47:42.603 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-22T19:47:42.658 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-22T19:47:42.670 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-22T19:47:42.685 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-22T19:47:42.690 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-22T19:47:42.698 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-22T19:47:42.738 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-22T19:47:43.061 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-22T19:47:43.071 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-22T19:47:43.075 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-22T19:47:43.081 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-22T19:47:43.083 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-22T19:47:43.111 INFO:teuthology.orchestra.run.trial155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-22T19:47:43.155 INFO:teuthology.orchestra.run.trial155.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-22T19:47:43.161 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-22T19:47:43.165 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-22T19:47:43.171 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-22T19:47:43.174 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-22T19:47:43.181 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-22T19:47:43.184 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-22T19:47:43.212 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-22T19:47:43.222 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-22T19:47:43.257 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-22T19:47:43.480 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-22T19:47:43.504 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-22T19:47:43.507 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-22T19:47:43.566 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-22T19:47:43.568 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-22T19:47:43.589 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-22T19:47:43.915 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-22T19:47:43.989 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-22T19:47:44.658 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-22T19:47:44.674 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-22T19:47:44.684 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-22T19:47:44.691 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-22T19:47:44.704 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-22T19:47:44.720 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-22T19:47:44.795 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-22T19:47:44.804 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-22T19:47:44.827 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-22T19:47:44.857 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-22T19:47:44.907 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-22T19:47:44.913 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-22T19:47:44.918 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-22T19:47:44.919 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-22T19:47:44.937 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T19:47:44.937 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T19:47:44.937 INFO:teuthology.orchestra.run.trial155.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T19:47:44.937 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:44.944 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T19:47:44.969 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T19:47:44.969 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T19:47:44.969 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:45.003 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-22T19:47:45.067 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-22T19:47:45.069 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T19:47:45.082 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T19:47:45.083 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:47:45.083 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T19:47:45.083 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:45.779 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T19:47:45.805 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T19:47:45.805 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:47:45.805 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T19:47:45.805 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T19:47:45.806 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T19:47:45.806 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:45.863 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T19:47:45.865 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T19:47:45.870 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 88/99 2026-02-22T19:47:45.889 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 89/99 2026-02-22T19:47:45.890 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T19:47:46.386 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T19:47:46.389 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T19:47:46.841 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T19:47:46.842 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T19:47:46.855 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T19:47:46.855 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T19:47:46.911 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T19:47:46.960 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 94/99 2026-02-22T19:47:46.961 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T19:47:46.983 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T19:47:46.983 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:47:46.983 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T19:47:46.983 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T19:47:46.983 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T19:47:46.983 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:46.994 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T19:47:47.211 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T19:47:47.215 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T19:47:47.233 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T19:47:47.233 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:47:47.233 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T19:47:47.233 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T19:47:47.233 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T19:47:47.233 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:47.335 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T19:47:47.356 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T19:47:47.356 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:47:47.357 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T19:47:47.357 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T19:47:47.357 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T19:47:47.357 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:47.375 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T19:47:48.025 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T19:47:48.025 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/99 2026-02-22T19:47:48.025 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/99 2026-02-22T19:47:48.026 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-22T19:47:48.027 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-22T19:47:48.028 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-22T19:47:48.029 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-22T19:47:48.030 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-22T19:47:48.031 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-22T19:47:48.032 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-22T19:47:48.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-22T19:47:48.088 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-22T19:47:48.088 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:48.088 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:47:48.088 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T19:47:48.088 INFO:teuthology.orchestra.run.trial155.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:48.088 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.088 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:48.088 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:47:48.089 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T19:47:48.090 INFO:teuthology.orchestra.run.trial155.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T19:47:48.091 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T19:47:48.092 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T19:47:48.093 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T19:47:48.094 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T19:47:48.094 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T19:47:48.094 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T19:47:48.094 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T19:47:48.094 INFO:teuthology.orchestra.run.trial155.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T19:47:48.094 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T19:47:48.094 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T19:47:48.094 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T19:47:48.095 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T19:47:48.096 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T19:47:48.097 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T19:47:48.097 INFO:teuthology.orchestra.run.trial155.stdout: zip-3.0-35.el9.x86_64 2026-02-22T19:47:48.097 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:48.097 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:48.144 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-base 2026-02-22T19:47:48.459 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:46 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:48.524 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:47:48.542 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:48.543 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:48.543 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:48.565 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install cephadm 2026-02-22T19:47:48.874 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:46 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:48.939 INFO:teuthology.orchestra.run.trial155.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:47:48.957 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:48.958 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:48.958 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:48.979 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-immutable-object-cache 2026-02-22T19:47:49.291 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:47 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:49.373 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 145 k 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 431 k 2026-02-22T19:47:49.374 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:47:50.073 INFO:teuthology.orchestra.run.trial155.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 208 kB/s | 145 kB 00:00 2026-02-22T19:47:50.073 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:47:50.073 INFO:teuthology.orchestra.run.trial155.stdout:Total 208 kB/s | 145 kB 00:00 2026-02-22T19:47:50.073 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:47:50.077 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:47:50.077 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:47:50.109 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:47:50.109 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:47:50.163 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:47:50.165 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T19:47:50.187 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T19:47:50.187 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:47:50.187 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T19:47:50.187 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:50.489 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T19:47:50.489 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:50.489 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:47:50.489 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:50.489 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:50.489 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:50.517 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr 2026-02-22T19:47:50.832 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:48 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:50.897 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:47:50.915 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:50.915 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:50.915 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:50.937 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-dashboard 2026-02-22T19:47:51.252 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:49 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:51.315 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:47:51.333 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:51.334 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:51.334 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:51.356 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-22T19:47:51.663 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:49 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:51.728 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:47:51.746 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:51.747 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:51.747 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:51.767 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-rook 2026-02-22T19:47:52.078 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:50 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:52.143 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:47:52.162 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:52.162 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:52.163 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:52.184 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-cephadm 2026-02-22T19:47:52.496 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:50 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:52.561 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:47:52.579 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:52.580 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:52.580 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:52.601 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-fuse 2026-02-22T19:47:52.908 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:50 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:52.992 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 1.2 M 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 3.6 M 2026-02-22T19:47:52.993 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:47:54.800 INFO:teuthology.orchestra.run.trial155.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 653 kB/s | 1.2 MB 00:01 2026-02-22T19:47:54.801 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:47:54.801 INFO:teuthology.orchestra.run.trial155.stdout:Total 653 kB/s | 1.2 MB 00:01 2026-02-22T19:47:54.801 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:47:54.805 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:47:54.805 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:47:54.841 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:47:54.841 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:47:54.945 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:47:54.962 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:55.196 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:55.253 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:55.253 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:55.253 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:47:55.253 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:55.253 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:55.253 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:55.279 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-volume 2026-02-22T19:47:55.591 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:53 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:55.656 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:47:55.674 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:55.675 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:55.675 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:55.696 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados-devel 2026-02-22T19:47:56.005 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:53 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:56.088 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:56.089 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:56.089 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-22T19:47:56.089 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:56.089 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:47:56.089 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T19:47:56.089 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:56.089 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:47:56.090 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:56.090 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T19:47:56.090 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:56.090 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 126 k 2026-02-22T19:47:56.090 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 456 k 2026-02-22T19:47:56.090 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:47:56.709 INFO:teuthology.orchestra.run.trial155.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 204 kB/s | 126 kB 00:00 2026-02-22T19:47:56.710 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:47:56.710 INFO:teuthology.orchestra.run.trial155.stdout:Total 203 kB/s | 126 kB 00:00 2026-02-22T19:47:56.711 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:47:56.713 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:47:56.713 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:47:56.746 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:47:56.746 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:47:56.801 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:47:56.817 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:56.901 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:56.958 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:56.958 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:56.958 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:47:56.958 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:56.958 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:56.959 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:56.985 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs2 2026-02-22T19:47:57.299 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:55 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:57.366 INFO:teuthology.orchestra.run.trial155.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:47:57.385 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:57.385 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:57.386 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:57.406 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs-devel 2026-02-22T19:47:57.714 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:55 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:57.800 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:57.800 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:57.800 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-22T19:47:57.800 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:57.800 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:47:57.800 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T19:47:57.800 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:47:57.801 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:47:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T19:47:57.801 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 34 k 2026-02-22T19:47:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 153 k 2026-02-22T19:47:57.801 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:47:58.150 INFO:teuthology.orchestra.run.trial155.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 96 kB/s | 34 kB 00:00 2026-02-22T19:47:58.150 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:47:58.150 INFO:teuthology.orchestra.run.trial155.stdout:Total 96 kB/s | 34 kB 00:00 2026-02-22T19:47:58.150 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:47:58.152 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:47:58.152 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:47:58.156 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:47:58.156 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:47:58.177 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:47:58.193 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:58.249 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:58.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:47:58.306 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:58.306 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:47:58.307 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:47:58.307 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:47:58.307 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:58.335 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados2 2026-02-22T19:47:58.645 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:56 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:58.710 INFO:teuthology.orchestra.run.trial155.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:47:58.728 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:58.729 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:58.729 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:58.750 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librbd1 2026-02-22T19:47:59.058 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:57 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:59.122 INFO:teuthology.orchestra.run.trial155.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:47:59.141 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:59.142 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:59.142 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:59.163 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rados 2026-02-22T19:47:59.470 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:57 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:59.537 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:47:59.556 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:59.556 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:59.556 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:47:59.577 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rgw 2026-02-22T19:47:59.893 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:57 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:47:59.959 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:47:59.978 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:47:59.979 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:47:59.979 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:48:00.000 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-cephfs 2026-02-22T19:48:00.308 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:58 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:48:00.374 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:48:00.392 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:48:00.393 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:48:00.393 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:48:00.414 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rbd 2026-02-22T19:48:00.722 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:58 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:48:00.787 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:48:00.805 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:48:00.806 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T19:48:00.806 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:48:00.828 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-fuse 2026-02-22T19:48:01.137 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:59 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:48:01.220 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:48:01.220 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 85 k 2026-02-22T19:48:01.221 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 227 k 2026-02-22T19:48:01.222 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:48:01.629 INFO:teuthology.orchestra.run.trial155.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 209 kB/s | 85 kB 00:00 2026-02-22T19:48:01.629 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:48:01.630 INFO:teuthology.orchestra.run.trial155.stdout:Total 208 kB/s | 85 kB 00:00 2026-02-22T19:48:01.630 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:48:01.633 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:48:01.633 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:48:01.664 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:48:01.664 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:48:01.715 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:48:01.732 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:01.813 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:01.871 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:01.871 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:01.871 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:48:01.871 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:48:01.871 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:01.871 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:48:01.898 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-mirror 2026-02-22T19:48:02.214 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:02:00 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 3.1 M 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 13 M 2026-02-22T19:48:02.297 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:48:06.316 INFO:teuthology.orchestra.run.trial155.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 794 kB/s | 3.1 MB 00:04 2026-02-22T19:48:06.317 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:48:06.317 INFO:teuthology.orchestra.run.trial155.stdout:Total 794 kB/s | 3.1 MB 00:04 2026-02-22T19:48:06.318 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:48:06.322 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:48:06.322 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:48:06.362 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:48:06.362 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:48:06.553 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:48:06.554 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:06.577 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:06.577 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:48:06.577 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T19:48:06.577 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T19:48:06.577 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T19:48:06.577 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:06.898 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:06.898 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:06.898 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:48:06.898 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:48:06.898 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:06.898 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:48:06.927 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-nbd 2026-02-22T19:48:07.243 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:02:05 ago on Sun 22 Feb 2026 07:46:02 PM UTC. 2026-02-22T19:48:07.326 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T19:48:07.327 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:07.328 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 170 k 2026-02-22T19:48:07.328 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 490 k 2026-02-22T19:48:07.328 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T19:48:07.986 INFO:teuthology.orchestra.run.trial155.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 259 kB/s | 170 kB 00:00 2026-02-22T19:48:07.987 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:48:07.987 INFO:teuthology.orchestra.run.trial155.stdout:Total 258 kB/s | 170 kB 00:00 2026-02-22T19:48:07.987 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T19:48:07.992 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T19:48:07.992 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T19:48:08.023 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T19:48:08.023 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T19:48:08.079 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T19:48:08.095 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:08.179 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:08.237 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:48:08.237 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:08.237 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T19:48:08.237 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:48:08.237 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:08.237 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T19:48:08.271 DEBUG:teuthology.parallel:result is None 2026-02-22T19:48:08.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:48:08.449 DEBUG:teuthology.orchestra.run.trial155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T19:48:08.470 INFO:teuthology.orchestra.run.trial155.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T19:48:08.470 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T19:48:08.471 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T19:48:08.473 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T19:48:08.473 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:08.473 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T19:48:08.536 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T19:48:08.537 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:08.537 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T19:48:08.600 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T19:48:08.664 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T19:48:08.664 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:08.664 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T19:48:08.728 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T19:48:08.793 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T19:48:08.793 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:08.793 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T19:48:08.858 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T19:48:08.924 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T19:48:09.038 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T19:48:09.038 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 777 /var/log/ceph 2026-02-22T19:48:09.063 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T19:48:09.063 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T19:48:09.125 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T19:48:09.125 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T19:48:09.200 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T19:48:09.200 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(PG_AVAILABILITY\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-22T19:48:09.200 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64013', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64013', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 5907, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYokLDDOAcRNSzMqMRXuxTvUAg6WQoh+w3B6gYR5EGmeR4tZlP3THG2Eai3bt0sCR1WQnHdCkpikeq4S6WO6dI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'fs': 'xfs', 'log-ignorelist': ['\\(PG_AVAILABILITY\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'cluster': 'ceph'}}, {'cram': {'clients': {'client.0': ['src/test/cli-integration/balancer/misplaced.t']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:40', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T19:48:09.201 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T19:48:09.248 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T19:48:09.311 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:09.312 DEBUG:teuthology.orchestra.run.trial155:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T19:48:09.368 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T19:48:09.368 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_1 2026-02-22T19:48:09.426 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T19:48:09.427 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T19:48:09.427 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-22T19:48:09.427 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T19:48:09.427 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T19:48:09.427 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 19:48:06.727483788 +0000 2026-02-22T19:48:09.427 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.427 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.427 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.428 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T19:48:09.488 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T19:48:09.489 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T19:48:09.489 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000162905 s, 3.1 MB/s 2026-02-22T19:48:09.490 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T19:48:09.548 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_2 2026-02-22T19:48:09.604 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T19:48:09.604 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T19:48:09.605 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-22T19:48:09.605 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T19:48:09.605 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T19:48:09.605 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 19:48:06.727483788 +0000 2026-02-22T19:48:09.605 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 19:46:20.023746567 +0000 2026-02-22T19:48:09.605 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 19:46:20.023746567 +0000 2026-02-22T19:48:09.605 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 19:46:20.023746567 +0000 2026-02-22T19:48:09.605 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T19:48:09.666 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T19:48:09.667 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T19:48:09.667 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000143509 s, 3.6 MB/s 2026-02-22T19:48:09.668 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T19:48:09.725 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_3 2026-02-22T19:48:09.782 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T19:48:09.782 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T19:48:09.782 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-22T19:48:09.782 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T19:48:09.782 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T19:48:09.783 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 19:48:06.727483788 +0000 2026-02-22T19:48:09.783 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.783 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.783 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.783 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T19:48:09.847 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T19:48:09.847 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T19:48:09.847 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000172563 s, 3.0 MB/s 2026-02-22T19:48:09.849 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T19:48:09.907 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_4 2026-02-22T19:48:09.964 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T19:48:09.964 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T19:48:09.964 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-22T19:48:09.964 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T19:48:09.964 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T19:48:09.964 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 19:48:06.727483788 +0000 2026-02-22T19:48:09.965 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.965 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.965 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 19:46:20.022746571 +0000 2026-02-22T19:48:09.965 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T19:48:10.026 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T19:48:10.027 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T19:48:10.027 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000146174 s, 3.5 MB/s 2026-02-22T19:48:10.028 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T19:48:10.086 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T19:48:10.086 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial155.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-22T19:48:10.086 INFO:tasks.ceph:Generating config... 2026-02-22T19:48:10.089 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-22T19:48:10.089 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T19:48:10.089 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T19:48:10.089 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T19:48:10.089 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T19:48:10.089 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T19:48:10.089 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-22T19:48:10.089 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-22T19:48:10.089 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T19:48:10.089 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T19:48:10.090 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-22T19:48:10.090 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-22T19:48:10.090 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-22T19:48:10.090 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-22T19:48:10.090 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-22T19:48:10.090 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-22T19:48:10.090 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-22T19:48:10.090 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T19:48:10.090 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T19:48:10.159 INFO:teuthology.orchestra.run.trial155.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T19:48:10.162 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T19:48:10.236 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T19:48:10.299 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.155')] 2026-02-22T19:48:10.300 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.155', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-22T19:48:10.301 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:10.301 DEBUG:teuthology.orchestra.run.trial155:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T19:48:10.356 DEBUG:teuthology.orchestra.run.trial155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.155 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:48:10.427 INFO:teuthology.orchestra.run.trial155.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:monmaptool: generated fsid 673832f4-4e16-4bf5-853c-7f01328aedab 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:setting min_mon_release = quincy 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:epoch 0 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:fsid 673832f4-4e16-4bf5-853c-7f01328aedab 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:last_changed 2026-02-22T19:48:10.423026+0000 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:created 2026-02-22T19:48:10.423026+0000 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:min_mon_release 17 (quincy) 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:election_strategy: 3 2026-02-22T19:48:10.428 INFO:teuthology.orchestra.run.trial155.stdout:0: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.a 2026-02-22T19:48:10.429 INFO:teuthology.orchestra.run.trial155.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-22T19:48:10.430 DEBUG:teuthology.orchestra.run.trial155:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T19:48:10.486 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 673832f4-4e16-4bf5-853c-7f01328aedab... 2026-02-22T19:48:10.488 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T19:48:10.566 INFO:teuthology.orchestra.run.trial155.stdout:[global] 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: chdir = "" 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: auth supported = cephx 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: filestore xattr use omap = true 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: mon clock drift allowed = 1.000 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: osd crush chooseleaf type = 0 2026-02-22T19:48:10.567 INFO:teuthology.orchestra.run.trial155.stdout: auth debug = true 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: ms die on old message = true 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: ms die on bug = true 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: mon pg warn max object skew = 0 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.568 INFO:teuthology.orchestra.run.trial155.stdout: osd pool default size = 2 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon osd allow primary affinity = true 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon osd allow pg remap = true 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on legacy crush tunables = false 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on crush straw calc version zero = false 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on no sortbitwise = false 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on osd down out interval zero = false 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on too few osds = false 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: mon_allow_pool_size_one = true 2026-02-22T19:48:10.569 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: osd default data pool replay window = 5 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: mon allow pool delete = true 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: mon cluster log file level = debug 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: debug asserts on shutdown = true 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: mon health detail to clog = false 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: mon host = 10.20.193.155 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: mon election default strategy = 3 2026-02-22T19:48:10.570 INFO:teuthology.orchestra.run.trial155.stdout: fsid = 673832f4-4e16-4bf5-853c-7f01328aedab 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout:[osd] 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: osd journal size = 100 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: osd scrub load threshold = 5.0 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: osd scrub max interval = 600 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock profile = high_recovery_ops 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock skip benchmark = True 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: osd recover clone overlap = true 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: osd recovery max chunk = 1048576 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.571 INFO:teuthology.orchestra.run.trial155.stdout: osd debug shutdown = true 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: osd debug op order = true 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify stray on activate = true 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: osd debug trim objects = true 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: osd open classes on start = true 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: osd debug pg log writeout = true 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: osd deep scrub update digest min age = 30 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: osd map max advance = 10 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: journal zero on create = true 2026-02-22T19:48:10.572 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: filestore ondisk finisher threads = 3 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: filestore apply finisher threads = 3 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: bdev debug aio = true 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: osd debug misdirected ops = true 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: bluestore zero block detection = True 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: debug osd = 20 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify cached snaps = True 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify missing on start = True 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock override recovery settings = True 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: osd op queue = debug_random 2026-02-22T19:48:10.573 INFO:teuthology.orchestra.run.trial155.stdout: osd op queue cut off = debug_random 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout:[mgr] 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: debug mgr = 20 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: debug mon = 20 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: debug auth = 20 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min pgs per osd = 4 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min bytes per osd = 10 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: mgr/telemetry/nag = false 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout:[mon] 2026-02-22T19:48:10.574 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: debug mon = 20 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: debug paxos = 20 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: debug auth = 20 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: mon data avail warn = 5 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: mon mgr mkfs grace = 240 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min pgs per osd = 4 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: mon osd reporter subtree level = osd 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: mon osd prime pg temp = true 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min bytes per osd = 10 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T19:48:10.575 INFO:teuthology.orchestra.run.trial155.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: # 1m isn't quite enough 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: mon_down_mkfs_grace = 2m 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_filestore_osds = false 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: mon scrub interval = 300 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout:[client] 2026-02-22T19:48:10.576 INFO:teuthology.orchestra.run.trial155.stdout: rgw cache enabled = true 2026-02-22T19:48:10.577 INFO:teuthology.orchestra.run.trial155.stdout: rgw enable ops log = true 2026-02-22T19:48:10.577 INFO:teuthology.orchestra.run.trial155.stdout: rgw enable usage log = true 2026-02-22T19:48:10.577 INFO:teuthology.orchestra.run.trial155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T19:48:10.577 INFO:teuthology.orchestra.run.trial155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T19:48:10.577 INFO:teuthology.orchestra.run.trial155.stdout:[mon.a] 2026-02-22T19:48:10.578 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T19:48:10.578 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T19:48:10.662 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T19:48:10.662 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:10.662 DEBUG:teuthology.orchestra.run.trial155:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T19:48:10.719 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:10.719 DEBUG:teuthology.orchestra.run.trial155:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T19:48:10.776 INFO:tasks.ceph:Sending monmap to node ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:48:10.777 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:10.777 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T19:48:10.777 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T19:48:10.848 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:10.848 DEBUG:teuthology.orchestra.run.trial155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:48:10.904 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T19:48:10.904 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T19:48:10.905 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T19:48:10.986 INFO:teuthology.orchestra.run.trial155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T19:48:10.989 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T19:48:10.989 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T19:48:10.989 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T19:48:11.063 INFO:teuthology.orchestra.run.trial155.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T19:48:11.074 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T19:48:11.074 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial155.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-22T19:48:11.075 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T19:48:11.138 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T19:48:11.138 INFO:tasks.ceph:role: osd.0 2026-02-22T19:48:11.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:48:11.139 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T19:48:11.205 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T19:48:11.205 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T19:48:11.205 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T19:48:11.206 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T19:48:11.206 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T19:48:11.206 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T19:48:11.206 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T19:48:11.206 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T19:48:11.206 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T19:48:11.206 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T19:48:11.775 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T19:48:11.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T19:48:11.777 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T19:48:11.845 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T19:48:11.913 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T19:48:11.978 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T19:48:11.978 INFO:tasks.ceph:role: osd.1 2026-02-22T19:48:11.978 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:48:11.978 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T19:48:12.043 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T19:48:12.043 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T19:48:12.043 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T19:48:12.043 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T19:48:12.044 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T19:48:12.044 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T19:48:12.044 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T19:48:12.044 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T19:48:12.044 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T19:48:12.044 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T19:48:12.601 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T19:48:12.603 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T19:48:12.603 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T19:48:12.673 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T19:48:12.740 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T19:48:12.803 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T19:48:12.803 INFO:tasks.ceph:role: osd.2 2026-02-22T19:48:12.804 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:48:12.804 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T19:48:12.870 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T19:48:12.871 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T19:48:13.426 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T19:48:13.428 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T19:48:13.428 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-22T19:48:13.498 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T19:48:13.565 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:48:13.642 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:13.637+0000 7fe5c2ca4780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T19:48:13.643 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:13.637+0000 7fe5c2ca4780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T19:48:13.643 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:13.637+0000 7fe5c2ca4780 -1 bdev(0x55c7bf983800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T19:48:13.643 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:13.637+0000 7fe5c2ca4780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T19:48:16.003 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T19:48:16.069 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:48:16.147 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:16.141+0000 7fc6b44a4780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T19:48:16.147 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:16.141+0000 7fc6b44a4780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T19:48:16.147 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:16.141+0000 7fc6b44a4780 -1 bdev(0x55afe8e39800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T19:48:16.147 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:16.141+0000 7fc6b44a4780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T19:48:18.504 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T19:48:18.568 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:48:18.645 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:18.640+0000 7f35917ad780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T19:48:18.646 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:18.640+0000 7f35917ad780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T19:48:18.646 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:18.640+0000 7f35917ad780 -1 bdev(0x55b00882f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T19:48:18.646 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T19:48:18.640+0000 7f35917ad780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T19:48:21.005 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T19:48:21.070 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T19:48:21.071 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:21.071 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T19:48:21.135 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:21.135 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T19:48:21.200 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:21.200 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T19:48:21.263 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:21.263 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T19:48:21.327 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:21.327 DEBUG:teuthology.orchestra.run.trial155:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T19:48:21.383 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T19:48:21.383 DEBUG:teuthology.orchestra.run.trial155:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T19:48:21.445 INFO:teuthology.orchestra.run.trial155.stdout:[mgr.x] 2026-02-22T19:48:21.445 INFO:teuthology.orchestra.run.trial155.stdout: key = AQB6XZtpn4uIOhAANREGS/wco2SAkuhhCaUYWQ== 2026-02-22T19:48:21.445 INFO:teuthology.orchestra.run.trial155.stdout:[osd.0] 2026-02-22T19:48:21.445 INFO:teuthology.orchestra.run.trial155.stdout: key = AQB9XZtpPlYHJhAApv8Eh8qkkvOCKHL9CcFMRw== 2026-02-22T19:48:21.445 INFO:teuthology.orchestra.run.trial155.stdout:[osd.1] 2026-02-22T19:48:21.445 INFO:teuthology.orchestra.run.trial155.stdout: key = AQCAXZtpLdV9CBAAbJ+GwZABsPupJrj2kjLUaA== 2026-02-22T19:48:21.445 INFO:teuthology.orchestra.run.trial155.stdout:[osd.2] 2026-02-22T19:48:21.445 INFO:teuthology.orchestra.run.trial155.stdout: key = AQCCXZtp4EI0JhAAkl3z3B0Exah9wOlC2C8CwA== 2026-02-22T19:48:21.446 INFO:teuthology.orchestra.run.trial155.stdout:[client.0] 2026-02-22T19:48:21.446 INFO:teuthology.orchestra.run.trial155.stdout: key = AQB7XZtpv9WCAxAAFPC+L2LEU61vGuNstvPcLA== 2026-02-22T19:48:21.447 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T19:48:21.526 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T19:48:21.606 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T19:48:21.686 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T19:48:21.766 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T19:48:21.845 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T19:48:21.846 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T19:48:21.911 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T19:48:21.993 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T19:48:22.057 DEBUG:teuthology.orchestra.run.trial155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:48:22.114 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T19:48:22.114 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T19:48:22.115 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T19:48:22.156 INFO:tasks.ceph.mon.a:Started 2026-02-22T19:48:22.157 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph config set mgr mgr_pool false --force 2026-02-22T19:48:22.263 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T19:48:22.264 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T19:48:22.264 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T19:48:22.266 INFO:tasks.ceph.mgr.x:Started 2026-02-22T19:48:22.266 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T19:48:22.266 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T19:48:22.365 INFO:teuthology.orchestra.run.trial155.stderr:adjusted tunables profile to default 2026-02-22T19:48:22.373 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T19:48:22.373 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T19:48:22.373 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:22.373 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T19:48:22.398 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:22.398 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T19:48:22.462 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T19:48:22.462 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T19:48:22.527 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new e972bf08-9144-4126-9e2c-6f53fe427ac7 0 2026-02-22T19:48:22.667 INFO:teuthology.orchestra.run.trial155.stdout:0 2026-02-22T19:48:22.673 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:22.667+0000 7f667dbb6140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T19:48:22.675 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new bb3d00c5-52b3-4c32-ad46-623014020577 1 2026-02-22T19:48:22.776 INFO:teuthology.orchestra.run.trial155.stdout:1 2026-02-22T19:48:22.784 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new 45487f63-3d29-4875-9eaf-62cb55bb01d3 2 2026-02-22T19:48:22.796 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:22.790+0000 7f667dbb6140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T19:48:22.823 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:22.818+0000 7f667dbb6140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T19:48:22.856 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:22.851+0000 7f667dbb6140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T19:48:22.880 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:22.875+0000 7f667dbb6140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T19:48:22.886 INFO:teuthology.orchestra.run.trial155.stdout:2 2026-02-22T19:48:22.895 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T19:48:22.895 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T19:48:22.907 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:22.901+0000 7f667dbb6140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T19:48:22.908 INFO:tasks.ceph.osd.0:Started 2026-02-22T19:48:22.909 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T19:48:22.909 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T19:48:22.911 INFO:tasks.ceph.osd.1:Started 2026-02-22T19:48:22.912 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T19:48:22.912 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T19:48:22.914 INFO:tasks.ceph.osd.2:Started 2026-02-22T19:48:22.915 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T19:48:22.965 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:22.959+0000 7f667dbb6140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T19:48:23.014 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:23.014 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":5,"fsid":"673832f4-4e16-4bf5-853c-7f01328aedab","created":"2026-02-22T19:48:22.213716+0000","modified":"2026-02-22T19:48:22.881678+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T19:48:22.881678+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e972bf08-9144-4126-9e2c-6f53fe427ac7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bb3d00c5-52b3-4c32-ad46-623014020577","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45487f63-3d29-4875-9eaf-62cb55bb01d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:48:23.022 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T19:48:23.022 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T19:48:23.026 INFO:tasks.ceph.mgr.x.trial155.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T19:48:23.026 INFO:tasks.ceph.mgr.x.trial155.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T19:48:23.026 INFO:tasks.ceph.mgr.x.trial155.stderr: from numpy import show_config as show_numpy_config 2026-02-22T19:48:23.030 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.024+0000 7f667dbb6140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T19:48:23.055 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.050+0000 7f667dbb6140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T19:48:23.112 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.107+0000 7f667dbb6140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-22T19:48:23.155 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.149+0000 7f667dbb6140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T19:48:23.180 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.175+0000 7f667dbb6140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T19:48:23.205 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.199+0000 7f667dbb6140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T19:48:23.231 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.225+0000 7f667dbb6140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T19:48:23.253 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.248+0000 7f667dbb6140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T19:48:23.325 DEBUG:teuthology.orchestra.run.trial155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T19:48:23.414 INFO:teuthology.misc.health.trial155.stdout: 2026-02-22T19:48:23.415 INFO:teuthology.misc.health.trial155.stdout:{"epoch":5,"fsid":"673832f4-4e16-4bf5-853c-7f01328aedab","created":"2026-02-22T19:48:22.213716+0000","modified":"2026-02-22T19:48:22.881678+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T19:48:22.881678+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e972bf08-9144-4126-9e2c-6f53fe427ac7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bb3d00c5-52b3-4c32-ad46-623014020577","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45487f63-3d29-4875-9eaf-62cb55bb01d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:48:23.419 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-22T19:48:23.448 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.442+0000 7f667dbb6140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-22T19:48:23.502 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.497+0000 7f667dbb6140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T19:48:23.524 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.519+0000 7f667dbb6140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T19:48:23.547 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.542+0000 7f667dbb6140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T19:48:23.600 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.595+0000 7f667dbb6140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T19:48:23.621 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.615+0000 7f667dbb6140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T19:48:23.673 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:23.667+0000 7f667dbb6140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T19:48:24.070 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:24.064+0000 7f667dbb6140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T19:48:24.092 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:24.086+0000 7f667dbb6140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T19:48:24.387 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T19:48:24.381+0000 7f53d2423780 -1 Falling back to public interface 2026-02-22T19:48:24.429 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:24.423+0000 7f667dbb6140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T19:48:24.857 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T19:48:24.851+0000 7f12d162a780 -1 Falling back to public interface 2026-02-22T19:48:24.861 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T19:48:24.855+0000 7f5de28eb780 -1 Falling back to public interface 2026-02-22T19:48:25.434 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:48:25.428+0000 7f659b33d640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-22T19:48:27.333 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T19:48:27.327+0000 7f53d2423780 -1 osd.0 0 log_to_monitors true 2026-02-22T19:48:27.574 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T19:48:27.569+0000 7f12d162a780 -1 osd.1 0 log_to_monitors true 2026-02-22T19:48:27.833 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T19:48:27.827+0000 7f5de28eb780 -1 osd.2 0 log_to_monitors true 2026-02-22T19:48:28.445 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T19:48:28.440+0000 7f53cde07640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T19:48:28.446 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T19:48:28.441+0000 7f53c9c31640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T19:48:29.456 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T19:48:29.451+0000 7f5dde878640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T19:48:29.457 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T19:48:29.452+0000 7f12cd5b7640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T19:48:29.458 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T19:48:29.452+0000 7f5dda6a2640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T19:48:29.459 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T19:48:29.453+0000 7f12c53d9640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T19:48:29.721 DEBUG:teuthology.orchestra.run.trial155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T19:48:29.871 INFO:teuthology.misc.health.trial155.stdout: 2026-02-22T19:48:29.872 INFO:teuthology.misc.health.trial155.stdout:{"epoch":8,"fsid":"673832f4-4e16-4bf5-853c-7f01328aedab","created":"2026-02-22T19:48:22.213716+0000","modified":"2026-02-22T19:48:29.434343+0000","last_up_change":"2026-02-22T19:48:29.434343+0000","last_in_change":"2026-02-22T19:48:22.881678+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e972bf08-9144-4126-9e2c-6f53fe427ac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6801","nonce":3293696732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6803","nonce":3293696732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6807","nonce":3293696732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6805","nonce":3293696732}]},"public_addr":"10.20.193.155:6801/3293696732","cluster_addr":"10.20.193.155:6803/3293696732","heartbeat_back_addr":"10.20.193.155:6807/3293696732","heartbeat_front_addr":"10.20.193.155:6805/3293696732","state":["exists","up"]},{"osd":1,"uuid":"bb3d00c5-52b3-4c32-ad46-623014020577","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45487f63-3d29-4875-9eaf-62cb55bb01d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:48:29.878 DEBUG:teuthology.misc:1 of 3 OSDs are up 2026-02-22T19:48:36.181 DEBUG:teuthology.orchestra.run.trial155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T19:48:36.331 INFO:teuthology.misc.health.trial155.stdout: 2026-02-22T19:48:36.332 INFO:teuthology.misc.health.trial155.stdout:{"epoch":10,"fsid":"673832f4-4e16-4bf5-853c-7f01328aedab","created":"2026-02-22T19:48:22.213716+0000","modified":"2026-02-22T19:48:31.438059+0000","last_up_change":"2026-02-22T19:48:30.436462+0000","last_in_change":"2026-02-22T19:48:22.881678+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e972bf08-9144-4126-9e2c-6f53fe427ac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6801","nonce":3293696732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6803","nonce":3293696732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6807","nonce":3293696732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6805","nonce":3293696732}]},"public_addr":"10.20.193.155:6801/3293696732","cluster_addr":"10.20.193.155:6803/3293696732","heartbeat_back_addr":"10.20.193.155:6807/3293696732","heartbeat_front_addr":"10.20.193.155:6805/3293696732","state":["exists","up"]},{"osd":1,"uuid":"bb3d00c5-52b3-4c32-ad46-623014020577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6811","nonce":2546030049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6813","nonce":2546030049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6817","nonce":2546030049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6815","nonce":2546030049}]},"public_addr":"10.20.193.155:6811/2546030049","cluster_addr":"10.20.193.155:6813/2546030049","heartbeat_back_addr":"10.20.193.155:6817/2546030049","heartbeat_front_addr":"10.20.193.155:6815/2546030049","state":["exists","up"]},{"osd":2,"uuid":"45487f63-3d29-4875-9eaf-62cb55bb01d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6819","nonce":1513012556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6820","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6821","nonce":1513012556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6824","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6825","nonce":1513012556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6823","nonce":1513012556}]},"public_addr":"10.20.193.155:6819/1513012556","cluster_addr":"10.20.193.155:6821/1513012556","heartbeat_back_addr":"10.20.193.155:6825/1513012556","heartbeat_front_addr":"10.20.193.155:6823/1513012556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.325027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.579209+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.804226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:48:36.339 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-22T19:48:36.339 INFO:tasks.ceph:Creating RBD pool 2026-02-22T19:48:36.339 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T19:48:37.450 INFO:teuthology.orchestra.run.trial155.stderr:pool 'rbd' created 2026-02-22T19:48:37.462 DEBUG:teuthology.orchestra.run.trial155:> rbd --cluster ceph pool init rbd 2026-02-22T19:48:40.464 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T19:48:40.464 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T19:48:40.464 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T19:48:40.464 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T19:48:40.465 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T19:48:40.645 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:40.653 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":4058849032},{"type":"v1","addr":"10.20.193.155:6809","nonce":4058849032}]},"active_addr":"10.20.193.155:6809/4058849032","active_change":"2026-02-22T19:48:24.425832+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":2704517564}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":1216745894}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":1564856322}]}]} 2026-02-22T19:48:40.654 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T19:48:40.654 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T19:48:40.654 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T19:48:40.811 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:40.811 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":14,"fsid":"673832f4-4e16-4bf5-853c-7f01328aedab","created":"2026-02-22T19:48:22.213716+0000","modified":"2026-02-22T19:48:40.450304+0000","last_up_change":"2026-02-22T19:48:30.436462+0000","last_in_change":"2026-02-22T19:48:22.881678+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T19:48:36.496044+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e972bf08-9144-4126-9e2c-6f53fe427ac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6801","nonce":3293696732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6803","nonce":3293696732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6807","nonce":3293696732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6805","nonce":3293696732}]},"public_addr":"10.20.193.155:6801/3293696732","cluster_addr":"10.20.193.155:6803/3293696732","heartbeat_back_addr":"10.20.193.155:6807/3293696732","heartbeat_front_addr":"10.20.193.155:6805/3293696732","state":["exists","up"]},{"osd":1,"uuid":"bb3d00c5-52b3-4c32-ad46-623014020577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6811","nonce":2546030049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6813","nonce":2546030049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6817","nonce":2546030049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6815","nonce":2546030049}]},"public_addr":"10.20.193.155:6811/2546030049","cluster_addr":"10.20.193.155:6813/2546030049","heartbeat_back_addr":"10.20.193.155:6817/2546030049","heartbeat_front_addr":"10.20.193.155:6815/2546030049","state":["exists","up"]},{"osd":2,"uuid":"45487f63-3d29-4875-9eaf-62cb55bb01d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6819","nonce":1513012556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6820","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6821","nonce":1513012556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6824","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6825","nonce":1513012556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6823","nonce":1513012556}]},"public_addr":"10.20.193.155:6819/1513012556","cluster_addr":"10.20.193.155:6821/1513012556","heartbeat_back_addr":"10.20.193.155:6825/1513012556","heartbeat_front_addr":"10.20.193.155:6823/1513012556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.325027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.579209+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.804226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:48:40.819 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T19:48:40.820 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T19:48:40.975 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:40.975 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":14,"fsid":"673832f4-4e16-4bf5-853c-7f01328aedab","created":"2026-02-22T19:48:22.213716+0000","modified":"2026-02-22T19:48:40.450304+0000","last_up_change":"2026-02-22T19:48:30.436462+0000","last_in_change":"2026-02-22T19:48:22.881678+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T19:48:36.496044+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e972bf08-9144-4126-9e2c-6f53fe427ac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6801","nonce":3293696732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6803","nonce":3293696732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6807","nonce":3293696732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6805","nonce":3293696732}]},"public_addr":"10.20.193.155:6801/3293696732","cluster_addr":"10.20.193.155:6803/3293696732","heartbeat_back_addr":"10.20.193.155:6807/3293696732","heartbeat_front_addr":"10.20.193.155:6805/3293696732","state":["exists","up"]},{"osd":1,"uuid":"bb3d00c5-52b3-4c32-ad46-623014020577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6811","nonce":2546030049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6813","nonce":2546030049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6817","nonce":2546030049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6815","nonce":2546030049}]},"public_addr":"10.20.193.155:6811/2546030049","cluster_addr":"10.20.193.155:6813/2546030049","heartbeat_back_addr":"10.20.193.155:6817/2546030049","heartbeat_front_addr":"10.20.193.155:6815/2546030049","state":["exists","up"]},{"osd":2,"uuid":"45487f63-3d29-4875-9eaf-62cb55bb01d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6819","nonce":1513012556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6820","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6821","nonce":1513012556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6824","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6825","nonce":1513012556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6823","nonce":1513012556}]},"public_addr":"10.20.193.155:6819/1513012556","cluster_addr":"10.20.193.155:6821/1513012556","heartbeat_back_addr":"10.20.193.155:6825/1513012556","heartbeat_front_addr":"10.20.193.155:6823/1513012556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.325027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.579209+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.804226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:48:40.983 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T19:48:40.983 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T19:48:40.983 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T19:48:41.067 INFO:teuthology.orchestra.run.trial155.stdout:34359738373 2026-02-22T19:48:41.068 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T19:48:41.068 INFO:teuthology.orchestra.run.trial155.stdout:38654705668 2026-02-22T19:48:41.068 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T19:48:41.069 INFO:teuthology.orchestra.run.trial155.stdout:38654705669 2026-02-22T19:48:41.069 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T19:48:41.229 INFO:teuthology.orchestra.run.trial155.stdout:38654705667 2026-02-22T19:48:41.231 INFO:teuthology.orchestra.run.trial155.stdout:34359738371 2026-02-22T19:48:41.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2026-02-22T19:48:41.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738371 for osd.0 2026-02-22T19:48:41.268 INFO:teuthology.orchestra.run.trial155.stdout:38654705668 2026-02-22T19:48:41.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2026-02-22T19:48:42.241 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T19:48:42.241 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T19:48:42.277 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T19:48:42.403 INFO:teuthology.orchestra.run.trial155.stdout:34359738371 2026-02-22T19:48:42.404 INFO:teuthology.orchestra.run.trial155.stdout:38654705667 2026-02-22T19:48:42.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738371 for osd.0 2026-02-22T19:48:42.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2026-02-22T19:48:42.445 INFO:teuthology.orchestra.run.trial155.stdout:38654705668 2026-02-22T19:48:42.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2026-02-22T19:48:43.415 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T19:48:43.415 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T19:48:43.455 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T19:48:43.577 INFO:teuthology.orchestra.run.trial155.stdout:38654705669 2026-02-22T19:48:43.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.2 2026-02-22T19:48:43.587 DEBUG:teuthology.parallel:result is None 2026-02-22T19:48:43.589 INFO:teuthology.orchestra.run.trial155.stdout:34359738373 2026-02-22T19:48:43.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2026-02-22T19:48:43.599 DEBUG:teuthology.parallel:result is None 2026-02-22T19:48:43.620 INFO:teuthology.orchestra.run.trial155.stdout:38654705670 2026-02-22T19:48:43.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705670 for osd.1 2026-02-22T19:48:43.630 DEBUG:teuthology.parallel:result is None 2026-02-22T19:48:43.630 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T19:48:43.630 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:48:43.823 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:43.823 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T19:48:43.831 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-22T19:48:42.429647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81240,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491560,"statfs":{"total":322122547200,"available":322039357440,"internally_reserved":0,"allocated":352256,"data_stored":86838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.978137"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452714+0000","last_change":"2026-02-22T19:48:40.452714+0000","last_active":"2026-02-22T19:48:40.452714+0000","last_peered":"2026-02-22T19:48:40.452714+0000","last_clean":"2026-02-22T19:48:40.452714+0000","last_became_active":"2026-02-22T19:48:38.451482+0000","last_became_peered":"2026-02-22T19:48:38.451482+0000","last_unstale":"2026-02-22T19:48:40.452714+0000","last_undegraded":"2026-02-22T19:48:40.452714+0000","last_fullsized":"2026-02-22T19:48:40.452714+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:43:37.230754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060628699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452379+0000","last_change":"2026-02-22T19:48:40.452379+0000","last_active":"2026-02-22T19:48:40.452379+0000","last_peered":"2026-02-22T19:48:40.452379+0000","last_clean":"2026-02-22T19:48:40.452379+0000","last_became_active":"2026-02-22T19:48:38.451987+0000","last_became_peered":"2026-02-22T19:48:38.451987+0000","last_unstale":"2026-02-22T19:48:40.452379+0000","last_undegraded":"2026-02-22T19:48:40.452379+0000","last_fullsized":"2026-02-22T19:48:40.452379+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:05:09.306758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028818000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.811924+0000","last_change":"2026-02-22T19:48:40.811924+0000","last_active":"2026-02-22T19:48:40.811924+0000","last_peered":"2026-02-22T19:48:40.811924+0000","last_clean":"2026-02-22T19:48:40.811924+0000","last_became_active":"2026-02-22T19:48:38.451617+0000","last_became_peered":"2026-02-22T19:48:38.451617+0000","last_unstale":"2026-02-22T19:48:40.811924+0000","last_undegraded":"2026-02-22T19:48:40.811924+0000","last_fullsized":"2026-02-22T19:48:40.811924+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:01:24.553053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00013828899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452672+0000","last_change":"2026-02-22T19:48:40.452672+0000","last_active":"2026-02-22T19:48:40.452672+0000","last_peered":"2026-02-22T19:48:40.452672+0000","last_clean":"2026-02-22T19:48:40.452672+0000","last_became_active":"2026-02-22T19:48:38.452120+0000","last_became_peered":"2026-02-22T19:48:38.452120+0000","last_unstale":"2026-02-22T19:48:40.452672+0000","last_undegraded":"2026-02-22T19:48:40.452672+0000","last_fullsized":"2026-02-22T19:48:40.452672+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:34:58.107973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056696299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"12'1","reported_seq":20,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452398+0000","last_change":"2026-02-22T19:48:40.452398+0000","last_active":"2026-02-22T19:48:40.452398+0000","last_peered":"2026-02-22T19:48:40.452398+0000","last_clean":"2026-02-22T19:48:40.452398+0000","last_became_active":"2026-02-22T19:48:38.451913+0000","last_became_peered":"2026-02-22T19:48:38.451913+0000","last_unstale":"2026-02-22T19:48:40.452398+0000","last_undegraded":"2026-02-22T19:48:40.452398+0000","last_fullsized":"2026-02-22T19:48:40.452398+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:48:38.738847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311935,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"14'2","reported_seq":21,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.454568+0000","last_change":"2026-02-22T19:48:40.454568+0000","last_active":"2026-02-22T19:48:40.454568+0000","last_peered":"2026-02-22T19:48:40.454568+0000","last_clean":"2026-02-22T19:48:40.454568+0000","last_became_active":"2026-02-22T19:48:38.451558+0000","last_became_peered":"2026-02-22T19:48:38.451558+0000","last_unstale":"2026-02-22T19:48:40.454568+0000","last_undegraded":"2026-02-22T19:48:40.454568+0000","last_fullsized":"2026-02-22T19:48:40.454568+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:13:39.725042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050788199999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.811932+0000","last_change":"2026-02-22T19:48:40.811932+0000","last_active":"2026-02-22T19:48:40.811932+0000","last_peered":"2026-02-22T19:48:40.811932+0000","last_clean":"2026-02-22T19:48:40.811932+0000","last_became_active":"2026-02-22T19:48:38.451626+0000","last_became_peered":"2026-02-22T19:48:38.451626+0000","last_unstale":"2026-02-22T19:48:40.811932+0000","last_undegraded":"2026-02-22T19:48:40.811932+0000","last_fullsized":"2026-02-22T19:48:40.811932+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:28:00.608002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019963500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452855+0000","last_change":"2026-02-22T19:48:40.452855+0000","last_active":"2026-02-22T19:48:40.452855+0000","last_peered":"2026-02-22T19:48:40.452855+0000","last_clean":"2026-02-22T19:48:40.452855+0000","last_became_active":"2026-02-22T19:48:38.451974+0000","last_became_peered":"2026-02-22T19:48:38.451974+0000","last_unstale":"2026-02-22T19:48:40.452855+0000","last_undegraded":"2026-02-22T19:48:40.452855+0000","last_fullsized":"2026-02-22T19:48:40.452855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:01:02.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070021199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":106496,"data_stored":25819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":118784,"data_stored":28917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:48:43.832 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:48:43.988 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:43.989 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T19:48:43.996 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-22T19:48:42.429647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81240,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491560,"statfs":{"total":322122547200,"available":322039357440,"internally_reserved":0,"allocated":352256,"data_stored":86838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.978137"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452714+0000","last_change":"2026-02-22T19:48:40.452714+0000","last_active":"2026-02-22T19:48:40.452714+0000","last_peered":"2026-02-22T19:48:40.452714+0000","last_clean":"2026-02-22T19:48:40.452714+0000","last_became_active":"2026-02-22T19:48:38.451482+0000","last_became_peered":"2026-02-22T19:48:38.451482+0000","last_unstale":"2026-02-22T19:48:40.452714+0000","last_undegraded":"2026-02-22T19:48:40.452714+0000","last_fullsized":"2026-02-22T19:48:40.452714+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:43:37.230754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060628699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452379+0000","last_change":"2026-02-22T19:48:40.452379+0000","last_active":"2026-02-22T19:48:40.452379+0000","last_peered":"2026-02-22T19:48:40.452379+0000","last_clean":"2026-02-22T19:48:40.452379+0000","last_became_active":"2026-02-22T19:48:38.451987+0000","last_became_peered":"2026-02-22T19:48:38.451987+0000","last_unstale":"2026-02-22T19:48:40.452379+0000","last_undegraded":"2026-02-22T19:48:40.452379+0000","last_fullsized":"2026-02-22T19:48:40.452379+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:05:09.306758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028818000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.811924+0000","last_change":"2026-02-22T19:48:40.811924+0000","last_active":"2026-02-22T19:48:40.811924+0000","last_peered":"2026-02-22T19:48:40.811924+0000","last_clean":"2026-02-22T19:48:40.811924+0000","last_became_active":"2026-02-22T19:48:38.451617+0000","last_became_peered":"2026-02-22T19:48:38.451617+0000","last_unstale":"2026-02-22T19:48:40.811924+0000","last_undegraded":"2026-02-22T19:48:40.811924+0000","last_fullsized":"2026-02-22T19:48:40.811924+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:01:24.553053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00013828899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452672+0000","last_change":"2026-02-22T19:48:40.452672+0000","last_active":"2026-02-22T19:48:40.452672+0000","last_peered":"2026-02-22T19:48:40.452672+0000","last_clean":"2026-02-22T19:48:40.452672+0000","last_became_active":"2026-02-22T19:48:38.452120+0000","last_became_peered":"2026-02-22T19:48:38.452120+0000","last_unstale":"2026-02-22T19:48:40.452672+0000","last_undegraded":"2026-02-22T19:48:40.452672+0000","last_fullsized":"2026-02-22T19:48:40.452672+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:34:58.107973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056696299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"12'1","reported_seq":20,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452398+0000","last_change":"2026-02-22T19:48:40.452398+0000","last_active":"2026-02-22T19:48:40.452398+0000","last_peered":"2026-02-22T19:48:40.452398+0000","last_clean":"2026-02-22T19:48:40.452398+0000","last_became_active":"2026-02-22T19:48:38.451913+0000","last_became_peered":"2026-02-22T19:48:38.451913+0000","last_unstale":"2026-02-22T19:48:40.452398+0000","last_undegraded":"2026-02-22T19:48:40.452398+0000","last_fullsized":"2026-02-22T19:48:40.452398+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:48:38.738847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311935,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"14'2","reported_seq":21,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.454568+0000","last_change":"2026-02-22T19:48:40.454568+0000","last_active":"2026-02-22T19:48:40.454568+0000","last_peered":"2026-02-22T19:48:40.454568+0000","last_clean":"2026-02-22T19:48:40.454568+0000","last_became_active":"2026-02-22T19:48:38.451558+0000","last_became_peered":"2026-02-22T19:48:38.451558+0000","last_unstale":"2026-02-22T19:48:40.454568+0000","last_undegraded":"2026-02-22T19:48:40.454568+0000","last_fullsized":"2026-02-22T19:48:40.454568+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:13:39.725042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050788199999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.811932+0000","last_change":"2026-02-22T19:48:40.811932+0000","last_active":"2026-02-22T19:48:40.811932+0000","last_peered":"2026-02-22T19:48:40.811932+0000","last_clean":"2026-02-22T19:48:40.811932+0000","last_became_active":"2026-02-22T19:48:38.451626+0000","last_became_peered":"2026-02-22T19:48:38.451626+0000","last_unstale":"2026-02-22T19:48:40.811932+0000","last_undegraded":"2026-02-22T19:48:40.811932+0000","last_fullsized":"2026-02-22T19:48:40.811932+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:28:00.608002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019963500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-22T19:48:40.452855+0000","last_change":"2026-02-22T19:48:40.452855+0000","last_active":"2026-02-22T19:48:40.452855+0000","last_peered":"2026-02-22T19:48:40.452855+0000","last_clean":"2026-02-22T19:48:40.452855+0000","last_became_active":"2026-02-22T19:48:38.451974+0000","last_became_peered":"2026-02-22T19:48:38.451974+0000","last_unstale":"2026-02-22T19:48:40.452855+0000","last_undegraded":"2026-02-22T19:48:40.452855+0000","last_fullsized":"2026-02-22T19:48:40.452855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:01:02.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070021199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":106496,"data_stored":25819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":118784,"data_stored":28917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:48:43.998 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T19:48:43.998 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T19:48:43.998 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T19:48:43.998 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T19:48:44.170 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:48:44.170 INFO:teuthology.orchestra.run.trial155.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T19:48:44.180 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T19:48:44.180 INFO:teuthology.run_tasks:Running task cram... 2026-02-22T19:48:44.202 INFO:tasks.cram:Pulling tests from https://github.com/ceph/ceph-ci.git ref f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:48:44.203 DEBUG:teuthology.orchestra.run.trial155:> mkdir -- /home/ubuntu/cephtest/archive/cram.client.0 && python3 -m venv /home/ubuntu/cephtest/virtualenv && /home/ubuntu/cephtest/virtualenv/bin/pip install cram==0.6 2026-02-22T19:48:45.431 INFO:teuthology.orchestra.run.trial155.stdout:Collecting cram==0.6 2026-02-22T19:48:45.470 INFO:teuthology.orchestra.run.trial155.stdout: Downloading cram-0.6-py2.py3-none-any.whl (17 kB) 2026-02-22T19:48:45.480 INFO:teuthology.orchestra.run.trial155.stdout:Installing collected packages: cram 2026-02-22T19:48:45.484 INFO:teuthology.orchestra.run.trial155.stdout:Successfully installed cram-0.6 2026-02-22T19:48:45.551 INFO:teuthology.orchestra.run.trial155.stderr:WARNING: You are using pip version 21.3.1; however, version 26.0.1 is available. 2026-02-22T19:48:45.551 INFO:teuthology.orchestra.run.trial155.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/virtualenv/bin/python3 -m pip install --upgrade pip' command. 2026-02-22T19:48:45.572 DEBUG:teuthology.orchestra.run.trial155:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:48:45.596 INFO:teuthology.orchestra.run.trial155.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-22T19:49:05.745 INFO:teuthology.orchestra.run.trial155.stderr:Note: switching to 'f90f4eaebb28b619cf76e80cbbe997656da69579'. 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr:state without impacting any branches by switching back to a branch. 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T19:49:05.746 INFO:teuthology.orchestra.run.trial155.stderr: git switch -c 2026-02-22T19:49:05.747 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T19:49:05.747 INFO:teuthology.orchestra.run.trial155.stderr:Or undo this operation with: 2026-02-22T19:49:05.747 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T19:49:05.747 INFO:teuthology.orchestra.run.trial155.stderr: git switch - 2026-02-22T19:49:05.747 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T19:49:05.747 INFO:teuthology.orchestra.run.trial155.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-22T19:49:05.747 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T19:49:05.747 INFO:teuthology.orchestra.run.trial155.stderr:HEAD is now at f90f4eaebb2 Merge branch 'wip-74712-squid' of https://github.com/idryomov/ceph into wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T19:49:05.753 DEBUG:teuthology.orchestra.run.trial155:> cp -- /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/balancer/misplaced.t /home/ubuntu/cephtest/archive/cram.client.0 2026-02-22T19:49:05.813 INFO:tasks.cram:Running tests for client.0... 2026-02-22T19:49:05.813 DEBUG:teuthology.orchestra.run.trial155:> CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t 2026-02-22T19:50:02.294 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T19:50:02.289+0000 7f6595331640 -1 mgr.server reply reply (2) No such file or directory plan test_plan not found 2026-02-22T19:50:03.242 INFO:tasks.cram.client.0.trial155.stdout:/home/ubuntu/cephtest/archive/cram.client.0/misplaced.t: passed 2026-02-22T19:50:03.242 INFO:tasks.cram.client.0.trial155.stdout:# Ran 1 tests, 0 skipped, 0 failed. 2026-02-22T19:50:03.248 DEBUG:teuthology.parallel:result is None 2026-02-22T19:50:03.248 DEBUG:teuthology.orchestra.run.trial155:> test -f /home/ubuntu/cephtest/archive/cram.client.0/misplaced.t.err || rm -f -- /home/ubuntu/cephtest/archive/cram.client.0/misplaced.t 2026-02-22T19:50:03.302 DEBUG:teuthology.orchestra.run.trial155:> rm -rf -- /home/ubuntu/cephtest/virtualenv /home/ubuntu/cephtest/clone.client.0 ; rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/archive/cram.client.0 2026-02-22T19:50:03.651 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T19:50:03.665 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T19:50:03.666 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:50:03.823 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:50:03.824 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T19:50:03.831 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2026-02-22T19:50:03.224152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":174998292,"kb_used_data":174834144,"kb_used_omap":4,"kb_used_meta":164091,"kb_avail":139574508,"statfs":{"total":322122547200,"available":142924296192,"internally_reserved":0,"allocated":179030163456,"data_stored":179029811906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":168029522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-85781905408,"num_objects":-20452,"num_object_clones":0,"num_object_copies":-40904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-20452,"num_write_kb":-83771392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.776302"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432346+0000","last_change":"2026-02-22T19:48:40.452714+0000","last_active":"2026-02-22T19:50:00.432346+0000","last_peered":"2026-02-22T19:50:00.432346+0000","last_clean":"2026-02-22T19:50:00.432346+0000","last_became_active":"2026-02-22T19:48:38.451482+0000","last_became_peered":"2026-02-22T19:48:38.451482+0000","last_unstale":"2026-02-22T19:50:00.432346+0000","last_undegraded":"2026-02-22T19:50:00.432346+0000","last_fullsized":"2026-02-22T19:50:00.432346+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:43:37.230754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060628699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432263+0000","last_change":"2026-02-22T19:48:40.452379+0000","last_active":"2026-02-22T19:50:00.432263+0000","last_peered":"2026-02-22T19:50:00.432263+0000","last_clean":"2026-02-22T19:50:00.432263+0000","last_became_active":"2026-02-22T19:48:38.451987+0000","last_became_peered":"2026-02-22T19:48:38.451987+0000","last_unstale":"2026-02-22T19:50:00.432263+0000","last_undegraded":"2026-02-22T19:50:00.432263+0000","last_fullsized":"2026-02-22T19:50:00.432263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:05:09.306758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028818000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.263059+0000","last_change":"2026-02-22T19:48:40.811924+0000","last_active":"2026-02-22T19:49:09.263059+0000","last_peered":"2026-02-22T19:49:09.263059+0000","last_clean":"2026-02-22T19:49:09.263059+0000","last_became_active":"2026-02-22T19:48:38.451617+0000","last_became_peered":"2026-02-22T19:48:38.451617+0000","last_unstale":"2026-02-22T19:49:09.263059+0000","last_undegraded":"2026-02-22T19:49:09.263059+0000","last_fullsized":"2026-02-22T19:49:09.263059+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:01:24.553053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00013828899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432058+0000","last_change":"2026-02-22T19:48:40.452672+0000","last_active":"2026-02-22T19:50:00.432058+0000","last_peered":"2026-02-22T19:50:00.432058+0000","last_clean":"2026-02-22T19:50:00.432058+0000","last_became_active":"2026-02-22T19:48:38.452120+0000","last_became_peered":"2026-02-22T19:48:38.452120+0000","last_unstale":"2026-02-22T19:50:00.432058+0000","last_undegraded":"2026-02-22T19:50:00.432058+0000","last_fullsized":"2026-02-22T19:50:00.432058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:34:58.107973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056696299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.431746+0000","last_change":"2026-02-22T19:48:40.452398+0000","last_active":"2026-02-22T19:50:00.431746+0000","last_peered":"2026-02-22T19:50:00.431746+0000","last_clean":"2026-02-22T19:50:00.431746+0000","last_became_active":"2026-02-22T19:48:38.451913+0000","last_became_peered":"2026-02-22T19:48:38.451913+0000","last_unstale":"2026-02-22T19:50:00.431746+0000","last_undegraded":"2026-02-22T19:50:00.431746+0000","last_fullsized":"2026-02-22T19:50:00.431746+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:48:38.738847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311935,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":29,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.272434+0000","last_change":"2026-02-22T19:48:40.454568+0000","last_active":"2026-02-22T19:49:09.272434+0000","last_peered":"2026-02-22T19:49:09.272434+0000","last_clean":"2026-02-22T19:49:09.272434+0000","last_became_active":"2026-02-22T19:48:38.451558+0000","last_became_peered":"2026-02-22T19:48:38.451558+0000","last_unstale":"2026-02-22T19:49:09.272434+0000","last_undegraded":"2026-02-22T19:49:09.272434+0000","last_fullsized":"2026-02-22T19:49:09.272434+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:13:39.725042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050788199999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.261294+0000","last_change":"2026-02-22T19:48:40.811932+0000","last_active":"2026-02-22T19:49:09.261294+0000","last_peered":"2026-02-22T19:49:09.261294+0000","last_clean":"2026-02-22T19:49:09.261294+0000","last_became_active":"2026-02-22T19:48:38.451626+0000","last_became_peered":"2026-02-22T19:48:38.451626+0000","last_unstale":"2026-02-22T19:49:09.261294+0000","last_undegraded":"2026-02-22T19:49:09.261294+0000","last_fullsized":"2026-02-22T19:49:09.261294+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:28:00.608002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019963500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.431139+0000","last_change":"2026-02-22T19:48:40.452855+0000","last_active":"2026-02-22T19:50:00.431139+0000","last_peered":"2026-02-22T19:50:00.431139+0000","last_clean":"2026-02-22T19:50:00.431139+0000","last_became_active":"2026-02-22T19:48:38.451974+0000","last_became_peered":"2026-02-22T19:48:38.451974+0000","last_unstale":"2026-02-22T19:50:00.431139+0000","last_undegraded":"2026-02-22T19:50:00.431139+0000","last_fullsized":"2026-02-22T19:50:00.431139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:01:02.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070021199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47141160,"kb_used_data":47083672,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":57716440,"statfs":{"total":107374182400,"available":59101634560,"internally_reserved":0,"allocated":48213680128,"data_stored":48213569781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":65667324,"kb_used_data":65613992,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":39190276,"statfs":{"total":107374182400,"available":40130842624,"internally_reserved":0,"allocated":67188727808,"data_stored":67188605101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":62189808,"kb_used_data":62136480,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":42667792,"statfs":{"total":107374182400,"available":43691819008,"internally_reserved":0,"allocated":63627755520,"data_stored":63627637024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:50:03.833 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:50:03.990 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:50:03.991 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T19:50:03.998 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2026-02-22T19:50:03.224152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":174998292,"kb_used_data":174834144,"kb_used_omap":4,"kb_used_meta":164091,"kb_avail":139574508,"statfs":{"total":322122547200,"available":142924296192,"internally_reserved":0,"allocated":179030163456,"data_stored":179029811906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":168029522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-85781905408,"num_objects":-20452,"num_object_clones":0,"num_object_copies":-40904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-20452,"num_write_kb":-83771392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.776302"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432346+0000","last_change":"2026-02-22T19:48:40.452714+0000","last_active":"2026-02-22T19:50:00.432346+0000","last_peered":"2026-02-22T19:50:00.432346+0000","last_clean":"2026-02-22T19:50:00.432346+0000","last_became_active":"2026-02-22T19:48:38.451482+0000","last_became_peered":"2026-02-22T19:48:38.451482+0000","last_unstale":"2026-02-22T19:50:00.432346+0000","last_undegraded":"2026-02-22T19:50:00.432346+0000","last_fullsized":"2026-02-22T19:50:00.432346+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:43:37.230754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060628699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432263+0000","last_change":"2026-02-22T19:48:40.452379+0000","last_active":"2026-02-22T19:50:00.432263+0000","last_peered":"2026-02-22T19:50:00.432263+0000","last_clean":"2026-02-22T19:50:00.432263+0000","last_became_active":"2026-02-22T19:48:38.451987+0000","last_became_peered":"2026-02-22T19:48:38.451987+0000","last_unstale":"2026-02-22T19:50:00.432263+0000","last_undegraded":"2026-02-22T19:50:00.432263+0000","last_fullsized":"2026-02-22T19:50:00.432263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:05:09.306758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028818000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.263059+0000","last_change":"2026-02-22T19:48:40.811924+0000","last_active":"2026-02-22T19:49:09.263059+0000","last_peered":"2026-02-22T19:49:09.263059+0000","last_clean":"2026-02-22T19:49:09.263059+0000","last_became_active":"2026-02-22T19:48:38.451617+0000","last_became_peered":"2026-02-22T19:48:38.451617+0000","last_unstale":"2026-02-22T19:49:09.263059+0000","last_undegraded":"2026-02-22T19:49:09.263059+0000","last_fullsized":"2026-02-22T19:49:09.263059+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:01:24.553053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00013828899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432058+0000","last_change":"2026-02-22T19:48:40.452672+0000","last_active":"2026-02-22T19:50:00.432058+0000","last_peered":"2026-02-22T19:50:00.432058+0000","last_clean":"2026-02-22T19:50:00.432058+0000","last_became_active":"2026-02-22T19:48:38.452120+0000","last_became_peered":"2026-02-22T19:48:38.452120+0000","last_unstale":"2026-02-22T19:50:00.432058+0000","last_undegraded":"2026-02-22T19:50:00.432058+0000","last_fullsized":"2026-02-22T19:50:00.432058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:34:58.107973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056696299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.431746+0000","last_change":"2026-02-22T19:48:40.452398+0000","last_active":"2026-02-22T19:50:00.431746+0000","last_peered":"2026-02-22T19:50:00.431746+0000","last_clean":"2026-02-22T19:50:00.431746+0000","last_became_active":"2026-02-22T19:48:38.451913+0000","last_became_peered":"2026-02-22T19:48:38.451913+0000","last_unstale":"2026-02-22T19:50:00.431746+0000","last_undegraded":"2026-02-22T19:50:00.431746+0000","last_fullsized":"2026-02-22T19:50:00.431746+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:48:38.738847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311935,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":29,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.272434+0000","last_change":"2026-02-22T19:48:40.454568+0000","last_active":"2026-02-22T19:49:09.272434+0000","last_peered":"2026-02-22T19:49:09.272434+0000","last_clean":"2026-02-22T19:49:09.272434+0000","last_became_active":"2026-02-22T19:48:38.451558+0000","last_became_peered":"2026-02-22T19:48:38.451558+0000","last_unstale":"2026-02-22T19:49:09.272434+0000","last_undegraded":"2026-02-22T19:49:09.272434+0000","last_fullsized":"2026-02-22T19:49:09.272434+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:13:39.725042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050788199999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.261294+0000","last_change":"2026-02-22T19:48:40.811932+0000","last_active":"2026-02-22T19:49:09.261294+0000","last_peered":"2026-02-22T19:49:09.261294+0000","last_clean":"2026-02-22T19:49:09.261294+0000","last_became_active":"2026-02-22T19:48:38.451626+0000","last_became_peered":"2026-02-22T19:48:38.451626+0000","last_unstale":"2026-02-22T19:49:09.261294+0000","last_undegraded":"2026-02-22T19:49:09.261294+0000","last_fullsized":"2026-02-22T19:49:09.261294+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:28:00.608002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019963500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.431139+0000","last_change":"2026-02-22T19:48:40.452855+0000","last_active":"2026-02-22T19:50:00.431139+0000","last_peered":"2026-02-22T19:50:00.431139+0000","last_clean":"2026-02-22T19:50:00.431139+0000","last_became_active":"2026-02-22T19:48:38.451974+0000","last_became_peered":"2026-02-22T19:48:38.451974+0000","last_unstale":"2026-02-22T19:50:00.431139+0000","last_undegraded":"2026-02-22T19:50:00.431139+0000","last_fullsized":"2026-02-22T19:50:00.431139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:01:02.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070021199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47141160,"kb_used_data":47083672,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":57716440,"statfs":{"total":107374182400,"available":59101634560,"internally_reserved":0,"allocated":48213680128,"data_stored":48213569781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":65667324,"kb_used_data":65613992,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":39190276,"statfs":{"total":107374182400,"available":40130842624,"internally_reserved":0,"allocated":67188727808,"data_stored":67188605101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":62189808,"kb_used_data":62136480,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":42667792,"statfs":{"total":107374182400,"available":43691819008,"internally_reserved":0,"allocated":63627755520,"data_stored":63627637024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:50:03.999 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T19:50:04.000 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:50:04.159 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:50:04.160 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T19:50:04.169 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2026-02-22T19:50:03.224152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":174998292,"kb_used_data":174834144,"kb_used_omap":4,"kb_used_meta":164091,"kb_avail":139574508,"statfs":{"total":322122547200,"available":142924296192,"internally_reserved":0,"allocated":179030163456,"data_stored":179029811906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":168029522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-85781905408,"num_objects":-20452,"num_object_clones":0,"num_object_copies":-40904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-20452,"num_write_kb":-83771392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.776302"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432346+0000","last_change":"2026-02-22T19:48:40.452714+0000","last_active":"2026-02-22T19:50:00.432346+0000","last_peered":"2026-02-22T19:50:00.432346+0000","last_clean":"2026-02-22T19:50:00.432346+0000","last_became_active":"2026-02-22T19:48:38.451482+0000","last_became_peered":"2026-02-22T19:48:38.451482+0000","last_unstale":"2026-02-22T19:50:00.432346+0000","last_undegraded":"2026-02-22T19:50:00.432346+0000","last_fullsized":"2026-02-22T19:50:00.432346+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:43:37.230754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060628699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432263+0000","last_change":"2026-02-22T19:48:40.452379+0000","last_active":"2026-02-22T19:50:00.432263+0000","last_peered":"2026-02-22T19:50:00.432263+0000","last_clean":"2026-02-22T19:50:00.432263+0000","last_became_active":"2026-02-22T19:48:38.451987+0000","last_became_peered":"2026-02-22T19:48:38.451987+0000","last_unstale":"2026-02-22T19:50:00.432263+0000","last_undegraded":"2026-02-22T19:50:00.432263+0000","last_fullsized":"2026-02-22T19:50:00.432263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:05:09.306758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028818000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.263059+0000","last_change":"2026-02-22T19:48:40.811924+0000","last_active":"2026-02-22T19:49:09.263059+0000","last_peered":"2026-02-22T19:49:09.263059+0000","last_clean":"2026-02-22T19:49:09.263059+0000","last_became_active":"2026-02-22T19:48:38.451617+0000","last_became_peered":"2026-02-22T19:48:38.451617+0000","last_unstale":"2026-02-22T19:49:09.263059+0000","last_undegraded":"2026-02-22T19:49:09.263059+0000","last_fullsized":"2026-02-22T19:49:09.263059+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:01:24.553053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00013828899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432058+0000","last_change":"2026-02-22T19:48:40.452672+0000","last_active":"2026-02-22T19:50:00.432058+0000","last_peered":"2026-02-22T19:50:00.432058+0000","last_clean":"2026-02-22T19:50:00.432058+0000","last_became_active":"2026-02-22T19:48:38.452120+0000","last_became_peered":"2026-02-22T19:48:38.452120+0000","last_unstale":"2026-02-22T19:50:00.432058+0000","last_undegraded":"2026-02-22T19:50:00.432058+0000","last_fullsized":"2026-02-22T19:50:00.432058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:34:58.107973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056696299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.431746+0000","last_change":"2026-02-22T19:48:40.452398+0000","last_active":"2026-02-22T19:50:00.431746+0000","last_peered":"2026-02-22T19:50:00.431746+0000","last_clean":"2026-02-22T19:50:00.431746+0000","last_became_active":"2026-02-22T19:48:38.451913+0000","last_became_peered":"2026-02-22T19:48:38.451913+0000","last_unstale":"2026-02-22T19:50:00.431746+0000","last_undegraded":"2026-02-22T19:50:00.431746+0000","last_fullsized":"2026-02-22T19:50:00.431746+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:48:38.738847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311935,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":29,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.272434+0000","last_change":"2026-02-22T19:48:40.454568+0000","last_active":"2026-02-22T19:49:09.272434+0000","last_peered":"2026-02-22T19:49:09.272434+0000","last_clean":"2026-02-22T19:49:09.272434+0000","last_became_active":"2026-02-22T19:48:38.451558+0000","last_became_peered":"2026-02-22T19:48:38.451558+0000","last_unstale":"2026-02-22T19:49:09.272434+0000","last_undegraded":"2026-02-22T19:49:09.272434+0000","last_fullsized":"2026-02-22T19:49:09.272434+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:13:39.725042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050788199999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.261294+0000","last_change":"2026-02-22T19:48:40.811932+0000","last_active":"2026-02-22T19:49:09.261294+0000","last_peered":"2026-02-22T19:49:09.261294+0000","last_clean":"2026-02-22T19:49:09.261294+0000","last_became_active":"2026-02-22T19:48:38.451626+0000","last_became_peered":"2026-02-22T19:48:38.451626+0000","last_unstale":"2026-02-22T19:49:09.261294+0000","last_undegraded":"2026-02-22T19:49:09.261294+0000","last_fullsized":"2026-02-22T19:49:09.261294+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:28:00.608002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019963500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.431139+0000","last_change":"2026-02-22T19:48:40.452855+0000","last_active":"2026-02-22T19:50:00.431139+0000","last_peered":"2026-02-22T19:50:00.431139+0000","last_clean":"2026-02-22T19:50:00.431139+0000","last_became_active":"2026-02-22T19:48:38.451974+0000","last_became_peered":"2026-02-22T19:48:38.451974+0000","last_unstale":"2026-02-22T19:50:00.431139+0000","last_undegraded":"2026-02-22T19:50:00.431139+0000","last_fullsized":"2026-02-22T19:50:00.431139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:01:02.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070021199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47141160,"kb_used_data":47083672,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":57716440,"statfs":{"total":107374182400,"available":59101634560,"internally_reserved":0,"allocated":48213680128,"data_stored":48213569781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":65667324,"kb_used_data":65613992,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":39190276,"statfs":{"total":107374182400,"available":40130842624,"internally_reserved":0,"allocated":67188727808,"data_stored":67188605101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":62189808,"kb_used_data":62136480,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":42667792,"statfs":{"total":107374182400,"available":43691819008,"internally_reserved":0,"allocated":63627755520,"data_stored":63627637024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:50:04.170 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T19:50:04.331 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:50:04.331 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":22,"fsid":"673832f4-4e16-4bf5-853c-7f01328aedab","created":"2026-02-22T19:48:22.213716+0000","modified":"2026-02-22T19:50:03.221020+0000","last_up_change":"2026-02-22T19:48:30.436462+0000","last_in_change":"2026-02-22T19:48:22.881678+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T19:48:36.496044+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e972bf08-9144-4126-9e2c-6f53fe427ac7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6801","nonce":3293696732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6803","nonce":3293696732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6807","nonce":3293696732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":3293696732},{"type":"v1","addr":"10.20.193.155:6805","nonce":3293696732}]},"public_addr":"10.20.193.155:6801/3293696732","cluster_addr":"10.20.193.155:6803/3293696732","heartbeat_back_addr":"10.20.193.155:6807/3293696732","heartbeat_front_addr":"10.20.193.155:6805/3293696732","state":["exists","up"]},{"osd":1,"uuid":"bb3d00c5-52b3-4c32-ad46-623014020577","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6811","nonce":2546030049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6813","nonce":2546030049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6817","nonce":2546030049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":2546030049},{"type":"v1","addr":"10.20.193.155:6815","nonce":2546030049}]},"public_addr":"10.20.193.155:6811/2546030049","cluster_addr":"10.20.193.155:6813/2546030049","heartbeat_back_addr":"10.20.193.155:6817/2546030049","heartbeat_front_addr":"10.20.193.155:6815/2546030049","state":["exists","up"]},{"osd":2,"uuid":"45487f63-3d29-4875-9eaf-62cb55bb01d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6819","nonce":1513012556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6820","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6821","nonce":1513012556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6824","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6825","nonce":1513012556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":1513012556},{"type":"v1","addr":"10.20.193.155:6823","nonce":1513012556}]},"public_addr":"10.20.193.155:6819/1513012556","cluster_addr":"10.20.193.155:6821/1513012556","heartbeat_back_addr":"10.20.193.155:6825/1513012556","heartbeat_front_addr":"10.20.193.155:6823/1513012556","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.325027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.579209+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:48:28.804226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:50:05.341 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T19:50:05.342 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T19:50:05.423 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T19:50:05.423 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T19:50:05.423 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T19:50:05.430 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T19:50:05.586 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T19:50:05.596 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T19:50:05.596 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T19:50:05.674 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T19:50:05.675 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T19:50:05.675 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T19:50:05.680 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T19:50:05.838 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T19:50:05.847 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T19:50:05.848 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T19:50:05.927 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T19:50:05.928 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T19:50:05.928 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T19:50:05.933 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T19:50:06.089 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T19:50:06.097 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:50:06.255 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:50:06.256 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T19:50:06.268 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2026-02-22T19:50:04.448668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":174998292,"kb_used_data":174834144,"kb_used_omap":4,"kb_used_meta":164091,"kb_avail":139574508,"statfs":{"total":322122547200,"available":142924296192,"internally_reserved":0,"allocated":179030163456,"data_stored":179029811906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":168029522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-85781905408,"num_objects":-20452,"num_object_clones":0,"num_object_copies":-40904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-20452,"num_write_kb":-83771392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.018958"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432346+0000","last_change":"2026-02-22T19:48:40.452714+0000","last_active":"2026-02-22T19:50:00.432346+0000","last_peered":"2026-02-22T19:50:00.432346+0000","last_clean":"2026-02-22T19:50:00.432346+0000","last_became_active":"2026-02-22T19:48:38.451482+0000","last_became_peered":"2026-02-22T19:48:38.451482+0000","last_unstale":"2026-02-22T19:50:00.432346+0000","last_undegraded":"2026-02-22T19:50:00.432346+0000","last_fullsized":"2026-02-22T19:50:00.432346+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:43:37.230754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060628699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432263+0000","last_change":"2026-02-22T19:48:40.452379+0000","last_active":"2026-02-22T19:50:00.432263+0000","last_peered":"2026-02-22T19:50:00.432263+0000","last_clean":"2026-02-22T19:50:00.432263+0000","last_became_active":"2026-02-22T19:48:38.451987+0000","last_became_peered":"2026-02-22T19:48:38.451987+0000","last_unstale":"2026-02-22T19:50:00.432263+0000","last_undegraded":"2026-02-22T19:50:00.432263+0000","last_fullsized":"2026-02-22T19:50:00.432263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:05:09.306758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028818000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.263059+0000","last_change":"2026-02-22T19:48:40.811924+0000","last_active":"2026-02-22T19:49:09.263059+0000","last_peered":"2026-02-22T19:49:09.263059+0000","last_clean":"2026-02-22T19:49:09.263059+0000","last_became_active":"2026-02-22T19:48:38.451617+0000","last_became_peered":"2026-02-22T19:48:38.451617+0000","last_unstale":"2026-02-22T19:49:09.263059+0000","last_undegraded":"2026-02-22T19:49:09.263059+0000","last_fullsized":"2026-02-22T19:49:09.263059+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:01:24.553053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00013828899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.432058+0000","last_change":"2026-02-22T19:48:40.452672+0000","last_active":"2026-02-22T19:50:00.432058+0000","last_peered":"2026-02-22T19:50:00.432058+0000","last_clean":"2026-02-22T19:50:00.432058+0000","last_became_active":"2026-02-22T19:48:38.452120+0000","last_became_peered":"2026-02-22T19:48:38.452120+0000","last_unstale":"2026-02-22T19:50:00.432058+0000","last_undegraded":"2026-02-22T19:50:00.432058+0000","last_fullsized":"2026-02-22T19:50:00.432058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:34:58.107973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056696299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.431746+0000","last_change":"2026-02-22T19:48:40.452398+0000","last_active":"2026-02-22T19:50:00.431746+0000","last_peered":"2026-02-22T19:50:00.431746+0000","last_clean":"2026-02-22T19:50:00.431746+0000","last_became_active":"2026-02-22T19:48:38.451913+0000","last_became_peered":"2026-02-22T19:48:38.451913+0000","last_unstale":"2026-02-22T19:50:00.431746+0000","last_undegraded":"2026-02-22T19:50:00.431746+0000","last_fullsized":"2026-02-22T19:50:00.431746+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:48:38.738847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311935,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":29,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.272434+0000","last_change":"2026-02-22T19:48:40.454568+0000","last_active":"2026-02-22T19:49:09.272434+0000","last_peered":"2026-02-22T19:49:09.272434+0000","last_clean":"2026-02-22T19:49:09.272434+0000","last_became_active":"2026-02-22T19:48:38.451558+0000","last_became_peered":"2026-02-22T19:48:38.451558+0000","last_unstale":"2026-02-22T19:49:09.272434+0000","last_undegraded":"2026-02-22T19:49:09.272434+0000","last_fullsized":"2026-02-22T19:49:09.272434+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:13:39.725042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050788199999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T19:49:09.261294+0000","last_change":"2026-02-22T19:48:40.811932+0000","last_active":"2026-02-22T19:49:09.261294+0000","last_peered":"2026-02-22T19:49:09.261294+0000","last_clean":"2026-02-22T19:49:09.261294+0000","last_became_active":"2026-02-22T19:48:38.451626+0000","last_became_peered":"2026-02-22T19:48:38.451626+0000","last_unstale":"2026-02-22T19:49:09.261294+0000","last_undegraded":"2026-02-22T19:49:09.261294+0000","last_fullsized":"2026-02-22T19:49:09.261294+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:28:00.608002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019963500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T19:50:00.431139+0000","last_change":"2026-02-22T19:48:40.452855+0000","last_active":"2026-02-22T19:50:00.431139+0000","last_peered":"2026-02-22T19:50:00.431139+0000","last_clean":"2026-02-22T19:50:00.431139+0000","last_became_active":"2026-02-22T19:48:38.451974+0000","last_became_peered":"2026-02-22T19:48:38.451974+0000","last_unstale":"2026-02-22T19:50:00.431139+0000","last_undegraded":"2026-02-22T19:50:00.431139+0000","last_fullsized":"2026-02-22T19:50:00.431139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:48:37.443596+0000","last_clean_scrub_stamp":"2026-02-22T19:48:37.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:01:02.713376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070021199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":47141160,"kb_used_data":47083672,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":57716440,"statfs":{"total":107374182400,"available":59101634560,"internally_reserved":0,"allocated":48213680128,"data_stored":48213569781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":65667324,"kb_used_data":65613992,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":39190276,"statfs":{"total":107374182400,"available":40130842624,"internally_reserved":0,"allocated":67188727808,"data_stored":67188605101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":62189808,"kb_used_data":62136480,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":42667792,"statfs":{"total":107374182400,"available":43691819008,"internally_reserved":0,"allocated":63627755520,"data_stored":63627637024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:50:06.273 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-22T19:48:37.443596+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=48, tm_sec=37, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:50:06.273 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-22T19:48:37.443596+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=48, tm_sec=37, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:50:06.274 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-22T19:48:37.443596+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=48, tm_sec=37, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:50:06.274 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-22T19:48:37.443596+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=48, tm_sec=37, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:50:06.274 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-22T19:48:37.443596+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=48, tm_sec=37, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:50:06.274 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-22T19:48:37.443596+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=48, tm_sec=37, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:50:06.274 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-22T19:48:37.443596+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=48, tm_sec=37, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:50:06.274 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T19:48:37.443596+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=48, tm_sec=37, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:50:06.275 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T19:50:26.275 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:50:26.434 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T19:50:26.434 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T19:50:26.442 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2026-02-22T19:50:24.450737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":168876,"kb_used_data":572,"kb_used_omap":4,"kb_used_meta":168251,"kb_avail":314403924,"statfs":{"total":322122547200,"available":321949618176,"internally_reserved":0,"allocated":585728,"data_stored":180482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":172289362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001074"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-22T19:50:05.852383+0000","last_change":"2026-02-22T19:50:05.852394+0000","last_active":"2026-02-22T19:50:05.852383+0000","last_peered":"2026-02-22T19:50:05.852383+0000","last_clean":"2026-02-22T19:50:05.852383+0000","last_became_active":"2026-02-22T19:48:38.451482+0000","last_became_peered":"2026-02-22T19:48:38.451482+0000","last_unstale":"2026-02-22T19:50:05.852383+0000","last_undegraded":"2026-02-22T19:50:05.852383+0000","last_fullsized":"2026-02-22T19:50:05.852383+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:50:05.852348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:50:05.852348+0000","last_clean_scrub_stamp":"2026-02-22T19:50:05.852348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:24:54.692501+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00060628699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-22T19:50:08.709458+0000","last_change":"2026-02-22T19:50:08.709473+0000","last_active":"2026-02-22T19:50:08.709458+0000","last_peered":"2026-02-22T19:50:08.709458+0000","last_clean":"2026-02-22T19:50:08.709458+0000","last_became_active":"2026-02-22T19:48:38.451987+0000","last_became_peered":"2026-02-22T19:48:38.451987+0000","last_unstale":"2026-02-22T19:50:08.709458+0000","last_undegraded":"2026-02-22T19:50:08.709458+0000","last_fullsized":"2026-02-22T19:50:08.709458+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:50:08.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:50:08.709404+0000","last_clean_scrub_stamp":"2026-02-22T19:50:08.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:15:40.770831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00028818000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-22T19:50:07.846153+0000","last_change":"2026-02-22T19:50:07.846162+0000","last_active":"2026-02-22T19:50:07.846153+0000","last_peered":"2026-02-22T19:50:07.846153+0000","last_clean":"2026-02-22T19:50:07.846153+0000","last_became_active":"2026-02-22T19:48:38.451617+0000","last_became_peered":"2026-02-22T19:48:38.451617+0000","last_unstale":"2026-02-22T19:50:07.846153+0000","last_undegraded":"2026-02-22T19:50:07.846153+0000","last_fullsized":"2026-02-22T19:50:07.846153+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:50:07.845937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:50:07.845937+0000","last_clean_scrub_stamp":"2026-02-22T19:50:07.845937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:08:43.416742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00013828899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-22T19:50:09.715404+0000","last_change":"2026-02-22T19:50:09.715422+0000","last_active":"2026-02-22T19:50:09.715404+0000","last_peered":"2026-02-22T19:50:09.715404+0000","last_clean":"2026-02-22T19:50:09.715404+0000","last_became_active":"2026-02-22T19:48:38.452120+0000","last_became_peered":"2026-02-22T19:48:38.452120+0000","last_unstale":"2026-02-22T19:50:09.715404+0000","last_undegraded":"2026-02-22T19:50:09.715404+0000","last_fullsized":"2026-02-22T19:50:09.715404+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:50:09.715332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:50:09.715332+0000","last_clean_scrub_stamp":"2026-02-22T19:50:09.715332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:29:51.194540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00056696299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"22'2","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-22T19:50:06.805540+0000","last_change":"2026-02-22T19:50:06.805552+0000","last_active":"2026-02-22T19:50:06.805540+0000","last_peered":"2026-02-22T19:50:06.805540+0000","last_clean":"2026-02-22T19:50:06.805540+0000","last_became_active":"2026-02-22T19:48:38.451913+0000","last_became_peered":"2026-02-22T19:48:38.451913+0000","last_unstale":"2026-02-22T19:50:06.805540+0000","last_undegraded":"2026-02-22T19:50:06.805540+0000","last_fullsized":"2026-02-22T19:50:06.805540+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2026-02-22T19:50:06.805505+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2026-02-22T19:50:06.805505+0000","last_clean_scrub_stamp":"2026-02-22T19:50:06.805505+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:37:55.884318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000311935,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"22'3","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-22T19:50:05.855323+0000","last_change":"2026-02-22T19:50:05.855339+0000","last_active":"2026-02-22T19:50:05.855323+0000","last_peered":"2026-02-22T19:50:05.855323+0000","last_clean":"2026-02-22T19:50:05.855323+0000","last_became_active":"2026-02-22T19:48:38.451558+0000","last_became_peered":"2026-02-22T19:48:38.451558+0000","last_unstale":"2026-02-22T19:50:05.855323+0000","last_undegraded":"2026-02-22T19:50:05.855323+0000","last_fullsized":"2026-02-22T19:50:05.855323+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2026-02-22T19:50:05.855289+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2026-02-22T19:50:05.855289+0000","last_clean_scrub_stamp":"2026-02-22T19:50:05.855289+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:21:39.716824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00050788199999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-22T19:50:06.854967+0000","last_change":"2026-02-22T19:50:06.854976+0000","last_active":"2026-02-22T19:50:06.854967+0000","last_peered":"2026-02-22T19:50:06.854967+0000","last_clean":"2026-02-22T19:50:06.854967+0000","last_became_active":"2026-02-22T19:48:38.451626+0000","last_became_peered":"2026-02-22T19:48:38.451626+0000","last_unstale":"2026-02-22T19:50:06.854967+0000","last_undegraded":"2026-02-22T19:50:06.854967+0000","last_fullsized":"2026-02-22T19:50:06.854967+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:50:06.854941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:50:06.854941+0000","last_clean_scrub_stamp":"2026-02-22T19:50:06.854941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T20:51:38.428120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00019963500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-22T19:50:07.757198+0000","last_change":"2026-02-22T19:50:07.757211+0000","last_active":"2026-02-22T19:50:07.757198+0000","last_peered":"2026-02-22T19:50:07.757198+0000","last_clean":"2026-02-22T19:50:07.757198+0000","last_became_active":"2026-02-22T19:48:38.451974+0000","last_became_peered":"2026-02-22T19:48:38.451974+0000","last_unstale":"2026-02-22T19:50:07.757198+0000","last_undegraded":"2026-02-22T19:50:07.757198+0000","last_fullsized":"2026-02-22T19:50:07.757198+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:50:07.757132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:50:07.757132+0000","last_clean_scrub_stamp":"2026-02-22T19:50:07.757132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:15:59.624714+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00070021199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705689,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":57676,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":104799924,"statfs":{"total":107374182400,"available":107315122176,"internally_reserved":0,"allocated":192512,"data_stored":60148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705690,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":53520,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":104804080,"statfs":{"total":107374182400,"available":107319377920,"internally_reserved":0,"allocated":196608,"data_stored":60167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":57680,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":104799920,"statfs":{"total":107374182400,"available":107315118080,"internally_reserved":0,"allocated":196608,"data_stored":60167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:50:26.444 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T19:50:26.613 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T19:50:26.613 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T19:50:26.613 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T19:50:26.613 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:50:26.661 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T19:50:26.661 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T19:50:26.661 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:50:26.714 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T19:50:26.714 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T19:50:26.714 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:50:26.757 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T19:50:26.757 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T19:50:26.758 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T19:50:26.758 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:50:26.789 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T19:50:26.789 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T19:50:26.789 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T19:50:26.789 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:50:26.838 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T19:50:26.839 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T19:50:26.839 DEBUG:teuthology.orchestra.run.trial155:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-22T19:50:26.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:50:26.908 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T19:50:26.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:50:26.980 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T19:50:27.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:50:27.058 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T19:50:27.129 INFO:tasks.ceph:Archiving mon data... 2026-02-22T19:50:27.131 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64013/data/mon.a.tgz 2026-02-22T19:50:27.131 DEBUG:teuthology.orchestra.run.trial155:> mktemp 2026-02-22T19:50:27.186 INFO:teuthology.orchestra.run.trial155.stdout:/tmp/tmp.KGuKxdyJ3i 2026-02-22T19:50:27.186 DEBUG:teuthology.orchestra.run.trial155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KGuKxdyJ3i 2026-02-22T19:50:27.271 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0666 /tmp/tmp.KGuKxdyJ3i 2026-02-22T19:50:27.395 DEBUG:teuthology.orchestra.remote:trial155:/tmp/tmp.KGuKxdyJ3i is 152KB 2026-02-22T19:50:27.445 DEBUG:teuthology.orchestra.run.trial155:> rm -fr /tmp/tmp.KGuKxdyJ3i 2026-02-22T19:50:27.461 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T19:50:27.462 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T19:50:27.582 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T19:50:27.582 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T19:50:27.585 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64013/remote/trial155/crash 2026-02-22T19:50:27.586 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T19:50:27.645 INFO:tasks.ceph:Compressing logs... 2026-02-22T19:50:27.645 DEBUG:teuthology.orchestra.run.trial155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T19:50:27.709 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43190.log 2026-02-22T19:50:27.727 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43190.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43190.log.gz 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44304.log 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.44304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44304.log.gz 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43479.log 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.43479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43479.log.gz 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44113.log 2026-02-22T19:50:27.728 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.44015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45221.log 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.44113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44113.log.gz 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45792.log 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41367.log 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45221.log.gz 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43074.log 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45792.log.gz 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41367.log.gz 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44352.log 2026-02-22T19:50:27.729 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45547.log 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43074.log.gz 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.44352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44352.log.gz 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37549.log 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45547.log.gz 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.tmp-client.admin.37549.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37549.log.gz 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43748.log 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41541.log 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43748.log.gz 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2026-02-22T19:50:27.730 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41541.log.gz 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41414.log 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.44329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45313.log 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41414.log.gz 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45450.log 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45313.log.gz 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45450.log.gz 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43378.log 2026-02-22T19:50:27.731 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45244.log 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43378.log.gz 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41320.log 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45244.log.gz 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45841.log 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41062.log 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41320.log.gz 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45841.log.gz 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46146.log 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43329.log 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41062.log.gz 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.46146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2026-02-22T19:50:27.732 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46146.log.gz 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44064.log 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43329.log.gz 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43747.log 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.44064.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.44064.log.gz --verbose 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr: -- /var/log/ceph/ceph-client.admin.45988.log 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43747.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.43747.log.gz --verbose -- 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr: /var/log/ceph/ceph-client.admin.45645.log 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45988.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45988.log.gz 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45645.log.gz 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45198.log 2026-02-22T19:50:27.733 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45198.log: 87.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45198.log.gz 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43894.log 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43280.log 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43894.log.gz 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43280.log.gz 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43481.log 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2026-02-22T19:50:27.734 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43481.log.gz 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44281.log 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45890.log 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.44281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44281.log.gz 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41174.log 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46037.log 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45890.log.gz 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41174.log.gz 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46099.log 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.46037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44258.log 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46037.log.gz 2026-02-22T19:50:27.735 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.46099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46099.log.gz 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45267.log 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.44258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45290.log 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44258.log.gz 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45267.log.gz 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43215.log 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45290.log.gz 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43779.log 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43215.log.gz 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45405.log 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43779.log.gz 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45336.log 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45428.log 2026-02-22T19:50:27.736 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45405.log.gz 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45336.log.gz 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45428.log.gz 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41605.log 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.41605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41605.log.gz 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45939.log 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2026-02-22T19:50:27.737 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45382.log 2026-02-22T19:50:27.738 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45939.log.gz 2026-02-22T19:50:27.738 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T19:50:27.738 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.45382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2026-02-22T19:50:27.738 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45382.log.gz 2026-02-22T19:50:27.738 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43120.log 2026-02-22T19:50:27.738 INFO:teuthology.orchestra.run.trial155.stderr: 83.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T19:50:27.738 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2026-02-22T19:50:27.738 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.43120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43120.log.gz 2026-02-22T19:50:27.739 INFO:teuthology.orchestra.run.trial155.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T19:50:27.743 INFO:teuthology.orchestra.run.trial155.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T19:50:28.790 INFO:teuthology.orchestra.run.trial155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T19:50:29.127 INFO:teuthology.orchestra.run.trial155.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T19:50:29.267 INFO:teuthology.orchestra.run.trial155.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T19:50:29.270 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T19:50:29.270 INFO:teuthology.orchestra.run.trial155.stderr:real 0m1.568s 2026-02-22T19:50:29.270 INFO:teuthology.orchestra.run.trial155.stderr:user 0m3.894s 2026-02-22T19:50:29.270 INFO:teuthology.orchestra.run.trial155.stderr:sys 0m0.240s 2026-02-22T19:50:29.270 INFO:tasks.ceph:Archiving logs... 2026-02-22T19:50:29.271 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64013/remote/trial155/log 2026-02-22T19:50:29.272 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T19:50:29.737 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T19:50:29.749 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T19:50:29.749 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T19:50:29.844 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T19:50:29.854 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T19:50:29.854 DEBUG:teuthology.orchestra.run.trial155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T19:50:29.871 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-22T19:50:30.135 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T19:50:30.136 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-22T19:50:30.136 INFO:teuthology.orchestra.run.trial155.stdout:^- 172-233-157-223.ip.linod> 2 6 377 15 -11ms[ -11ms] +/- 124ms 2026-02-22T19:50:30.136 INFO:teuthology.orchestra.run.trial155.stdout:^+ 108.61.215.221.vultruser> 3 6 377 14 -2804us[-2804us] +/- 21ms 2026-02-22T19:50:30.136 INFO:teuthology.orchestra.run.trial155.stdout:^* time.ecansol.net 1 6 377 14 +1741us[+1845us] +/- 16ms 2026-02-22T19:50:30.136 INFO:teuthology.orchestra.run.trial155.stdout:^+ ntp4.lonet.org 2 6 377 15 -2122us[-2018us] +/- 34ms 2026-02-22T19:50:30.136 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T19:50:30.148 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T19:50:30.149 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T19:50:30.163 DEBUG:teuthology.orchestra.run.trial155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T19:50:30.231 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T19:50:30.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:50:30.259 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T19:50:30.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T19:50:30.285 INFO:teuthology.task.internal:Duration was 423.459805 seconds 2026-02-22T19:50:30.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T19:50:30.302 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T19:50:30.302 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T19:50:30.338 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T19:50:30.575 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T19:50:30.575 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial155.front.sepia.ceph.com 2026-02-22T19:50:30.575 DEBUG:teuthology.orchestra.run.trial155:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T19:50:30.633 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T19:50:30.633 DEBUG:teuthology.orchestra.run.trial155:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T19:50:30.733 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T19:50:30.734 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T19:50:30.756 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T19:50:30.757 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T19:50:30.758 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T19:50:30.758 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T19:50:30.758 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T19:50:30.767 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T19:50:30.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T19:50:30.785 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T19:50:30.786 DEBUG:teuthology.orchestra.run.trial155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T19:50:30.836 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T19:50:30.852 DEBUG:teuthology.orchestra.run.trial155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T19:50:30.900 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = core 2026-02-22T19:50:30.912 DEBUG:teuthology.orchestra.run.trial155:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T19:50:30.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:50:30.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T19:50:30.984 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T19:50:30.986 DEBUG:teuthology.misc:Transferring archived files from trial155:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64013/remote/trial155 2026-02-22T19:50:30.986 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T19:50:31.044 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T19:50:31.063 DEBUG:teuthology.orchestra.run.trial155:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T19:50:31.090 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T19:50:31.109 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T19:50:31.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T19:50:31.122 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T19:50:31.122 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T19:50:31.146 INFO:teuthology.orchestra.run.trial155.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 19:50 /home/ubuntu/cephtest 2026-02-22T19:50:31.148 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T19:50:31.165 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T19:50:31.201 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}} duration: 423.4598045349121 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-22T19:50:31.202 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T19:50:31.318 INFO:teuthology.run:pass